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ABSTRACT 


Supply  and  demand  in  the  World  oil  market  are  balanced  through  responses  to  price  movement 
with  considerable  complexity  in  the  evolution  of  underlying  supply-demand  expectation  process. 

In  order  to  be  able  to  understand  the  price  balancing  process,  it  is  important  to  know  the  economic 
forces  and  the  behavior  of  energy  commodity  spot  price  processes.  The  relationship  between  the 
different  energy  sources  and  its  utility  together  with  uncertainty  also  play  a  role  in  many  important 
energy  issues.  The  qualitative  and  quantitative  behavior  of  energy  commodities  in  which  the  trend  in 
price  of  one  commodity  coincides  with  the  trend  in  price  of  other  commodities,  have  always  raised 
the  questions  regarding  their  interactions.  Moreover,  if  there  is  any  interaction,  then  one  would  like 
to  know  the  extent  of  influence  on  each  other.  In  this  work,  we  undertake  the  study  to  shed  a  light 
on  the  above  highlighted  processes  and  issues.  The  presented  study  systematically  deals  with  the 
development  of  stochastic  dynamic  models  and  mathematical,  statistical  and  computational  analysis 
of  energy  commodity  spot  price  and  interaction  processes. 

Below  we  list  the  main  components  of  the  research  carried  out  in  this  dissertation. 

(1)  Employing  basic  economic  principles,  interconnected  detenninistic  and  stochastic  models 

of  linear  log-spot  and  expected  log-spot  price  processes  coupled  with  non-linear  volatility  process 

are  initiated.  (2)  Closed  fonn  solutions  of  the  models  are  analyzed.  (3)  Introducing  a  change  of 

probability  measure,  a  risk-neutral  interconnected  stochastic  model  is  derived.  (4)  Furthermore, 

under  the  risk-neutral  measure,  expectation  of  the  square  of  volatility  is  reduced  to  a  continuoustime 

detenninistic  delay  differential  equation.  (5)  The  by-product  of  this  exhibits  the  hereditary  effects  on  the  mean-square 

volatility  process.  (6)  Using  a  numerical  scheme,  a  time-series  model  is  developed  and  utilized  to  estimate  the  state 

and  parameters  of  the  dynamic  model.  In  fact,  the  developed  time-series  model  includes  the  extended  GARCH  model 

as  special  case.  (7)  Using  the  Henry  Hub  natural  gas  data  set,  the  usefulness  of  the  linear  interconnected  stochastic 

models  is  outlined. 

(8)  Using  natural  and  basic  economic  ideas,  interconnected  deterministic  and  stochastic  models 
in  (1)  are  extended  to  non-linear  log-spot  price,  expected  log-spot  price  and  volatility  processes.  (9) 

The  presented  extended  models  are  validated.  (10)  Closed  fonn  solution  and  risk-neutral  models  of 
(8)  are  outlined.  (11)  To  exhibit  the  usefulness  of  the  non-linear  interconnected  stochastic  model,  to 
increase  the  efficiency  and  to  reduce  the  magnitude  of  error,  it  was  essential  to  develop  a  modified 
version  of  extended  Kalman  filtering  approach.  The  modified  approach  exhibits  the  reduction  of 
magnitude  of  error.  Furthermore,  Henry  Hub  natural  gas  data  set  is  used  to  show  the  advantages  of 
the  non-linear  interconnected  stochastic  model. 

(12)  Parameter  and  state  estimation  problems  of  continuous  time  non-linear  stochastic  dynamic 
process  is  motivated  to  initiate  an  alternative  innovative  approach.  This  led  to  introduce  the  concept 
of  statistic  processes,  namely,  local  sample  mean  and  sample  variance.  (13)  Then  it  led  to  the 
development  of  an  interconnected  discrete -time  dynamic  system  of  local  statistic  processes  and  (14) 
its  mathematical  model.  (15)  This  paved  the  way  for  developing  an  innovative  approach  referred  as  Focal  Fagged 
adapted  Generalized  Method  of  Moments  (FFGMM).  This  approach  exhibits  the  balance  between  model 
specification  and  model  prescription  of  continuous  time  dynamic  processes.  (16)  In  addition,  it  motivated  to  initiate 
conceptual  computational  state  and  parameter  estimation  and  simulation  schemes  that  generates  a  mean  square  sub- 
optimal  procedure.  (17)  The  usefulness  of  this  approach  is  illustrated  by  applying  this  technique  to  four  energy 
commodity  data  sets,  the  U.  S.  Treasury  Bill  Yield  Interest  Rate  and  the  U.S.  Eurocurrency  Exchange  Rate  data  sets 
for  state  and  parameter  estimation  problems.  (18)  Moreover,  the  forecasting  and  confidence-interval  problems  are 
also  investigated. 

(19)  The  non-linear  interconnected  stochastic  model  (8)  was  further  extended  to  multivariate 
interconnected  energy  commodities  and  sources  with  and  without  external  random  intervention  processes.  (20) 
Moreover,  it  was  essential  to  extend  the  interconnected  discrete-time  dynamic  system 

of  local  sample  mean  and  variance  processes  to  multivariate  discrete-time  dynamic  system.  (21)  Extending  the 
FFGMM  approach  in  (15)  to  a  multivariate  interconnected  stochastic  dynamic  model 
under  intervention  process,  the  parameters  in  the  multivariate  model  are  estimated.  These  estimated 
parameters  help  in  analyzing  the  short  and  long  tenn  relationship  between  the  energy  commodities. 


These  developed  results  are  applied  to  the  Henry  Hub  natural  gas,  crude  oil  and  coal  data  sets. 
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Abstract 


Supply  and  demand  in  the  World  oil  market  are  balanced  through  responses  to  price  movement 
with  considerable  complexity  in  the  evolution  of  underlying  supply-demand  expectation  process. 
In  order  to  be  able  to  understand  the  price  balancing  process,  it  is  important  to  know  the  economic 
forces  and  the  behavior  of  energy  commodity  spot  price  processes.  The  relationship  between  the 
different  energy  sources  and  its  utility  together  with  uncertainty  also  play  a  role  in  many  important 
energy  issues.  The  qualitative  and  quantitative  behavior  of  energy  commodities  in  which  the  trend  in 
price  of  one  commodity  coincides  with  the  trend  in  price  of  other  commodities,  have  always  raised 
the  questions  regarding  their  interactions.  Moreover,  if  there  is  any  interaction,  then  one  would  like 
to  know  the  extent  of  influence  on  each  other.  In  this  work,  we  undertake  the  study  to  shed  a  light 
on  the  above  highlighted  processes  and  issues.  The  presented  study  systematically  deals  with  the 
development  of  stochastic  dynamic  models  and  mathematical,  statistical  and  computational  analysis 
of  energy  commodity  spot  price  and  interaction  processes. 

Below  we  list  the  main  components  of  the  research  carried  out  in  this  dissertation. 

(1)  Employing  basic  economic  principles,  interconnected  deterministic  and  stochastic  models 
of  lineal-  log-spot  and  expected  log-spot  price  processes  coupled  with  non-linear  volatility  process 
are  initiated.  (2)  Closed  form  solutions  of  the  models  are  analyzed.  (3)  Introducing  a  change  of 
probability  measure,  a  risk-neutral  interconnected  stochastic  model  is  derived.  (4)  Furthermore, 
under  the  risk-neutral  measure,  expectation  of  the  square  of  volatility  is  reduced  to  a  continuous¬ 
time  deterministic  delay  differential  equation.  (5)  The  by-product  of  this  exhibits  the  hereditary 
effects  on  the  mean-square  volatility  process.  (6)  Using  a  numerical  scheme,  a  time-series  model 
is  developed  and  utilized  to  estimate  the  state  and  parameters  of  the  dynamic  model.  In  fact,  the 
developed  time-series  model  includes  the  extended  GARCH  model  as  special  case.  (7)  Using  the 
Henry  Hub  natural  gas  data  set,  the  usefulness  of  the  linear  interconnected  stochastic  models  is 


outlined. 


(8)  Using  natural  and  basic  economic  ideas,  interconnected  deterministic  and  stochastic  models 
in  (1)  are  extended  to  non-linear  log-spot  price,  expected  log-spot  price  and  volatility  processes.  (9) 
The  presented  extended  models  arc  validated.  (10)  Closed  form  solution  and  risk-neutral  models  of 
(8)  arc  outlined.  (11)  To  exhibit  the  usefulness  of  the  non-linear  interconnected  stochastic  model,  to 
increase  the  efficiency  and  to  reduce  the  magnitude  of  error,  it  was  essential  to  develop  a  modified 
version  of  extended  Kalman  filtering  approach.  The  modified  approach  exhibits  the  reduction  of 
magnitude  of  error.  Furthermore,  Henry  Hub  natural  gas  data  set  is  used  to  show  the  advantages  of 
the  non-linear  interconnected  stochastic  model. 

(12)  Parameter  and  state  estimation  problems  of  continuous  time  non-linear  stochastic  dynamic 
process  is  motivated  to  initiate  an  alternative  innovative  approach.  This  led  to  introduce  the  concept 
of  statistic  processes,  namely,  local  sample  mean  and  sample  variance.  (13)  Then  it  led  to  the 
development  of  an  interconnected  discrete-time  dynamic  system  of  local  statistic  processes  and  (14) 
its  mathematical  model.  (15)  This  paved  the  way  for  developing  an  innovative  approach  referred 
as  Local  Lagged  adapted  Generalized  Method  of  Moments  (LLGMM).  This  approach  exhibits  the 
balance  between  model  specification  and  model  prescription  of  continuous  time  dynamic  processes. 
(16)  In  addition,  it  motivated  to  initiate  conceptual  computational  state  and  parameter  estimation 
and  simulation  schemes  that  generates  a  mean  square  sub-optimal  procedure.  (17)  The  usefulness 
of  this  approach  is  illustrated  by  applying  this  technique  to  four  energy  commodity  data  sets,  the  U. 
S.  Treasury  Bill  Yield  Interest  Rate  and  the  U.S.  Eurocurrency  Exchange  Rate  data  sets  for  state  and 
parameter  estimation  problems.  (18)  Moreover,  the  forecasting  and  confidence-interval  problems 
arc  also  investigated. 

(19)  The  non-linear  interconnected  stochastic  model  (8)  was  further  extended  to  multivariate 
interconnected  energy  commodities  and  sources  with  and  without  external  random  intervention  pro¬ 
cesses.  (20)  Moreover,  it  was  essential  to  extend  the  interconnected  discrete-time  dynamic  system 
of  local  sample  mean  and  variance  processes  to  multivariate  discrete-time  dynamic  system.  (21)  Ex¬ 
tending  the  LLGMM  approach  in  (15)  to  a  multivariate  interconnected  stochastic  dynamic  model 
under  intervention  process,  the  parameters  in  the  multivariate  model  arc  estimated.  These  estimated 
parameters  help  in  analyzing  the  short  and  long  term  relationship  between  the  energy  commodities. 
These  developed  results  arc  applied  to  the  Henry  Hub  natural  gas,  crude  oil  and  coal  data  sets. 
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Chapter  1 

Preliminary  Concepts  and  Tools 


1.1  Introduction 

In  this  chapter,  we  shall  provide  a  number  of  basic  definitions  and  important  results  which  shall  be 
used  in  later  chapters. 

1.2  General  Notations 


i.e. 

a.s 

G  :=  H 
G{x)  =  H(x ) 
0 
Gt 
a  V  b 
f-.A^B 
Z 

Ia{b)  =  I{a,b) 


jg>nxm 


c 


that  is. 

almost  surely. 

G  is  defined  by  H  or  G  is  denoted  by  H. 

G(x)  and  H(x)  are  identically  equal. 

the  empty  set. 

the  transpose  of  G. 

the  maximum  of  a  and  b. 

the  mapping  /  from  ,4  to  B. 

set  of  integers 

the  set  {x  6  Z  :  a  <  x  <  b}. 

the  real  line. 

the  n-dimensional  Euclidean  space. 

the  set  of  all  nonnegative  real  numbers  [0,  oo). 

the  set  of  all  positive  real  numbers  (0,  oo). 

the  space  of  real  nx  m-matrices. 

the  family  of  all  real- valued  continuous  functions. 
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Cn  :  the  family  of  all  real-valued  functions  V ( x )  which  arc  continuously  n-times 
differentiable  in  x. 

Crhrn  :  the  family  of  all  real-valued  functions  V  (t,  x )  which  arc  continuously  n-times 
differentiable  in  t  and  m- times  differentiable  in  x. 
a  b  :  a  is  not  equal  to  b. 
a  €  A  :  a  is  an  element  of  A. 

||A||  =  ||A||2  :  the  Euclidean  norm  of  A. 

trA  =  traceA  :  the  trace  of  a  square  matrix  A. 

det  A  :  determinant  of  square  matrix  A. 

Vx  :  VV  =  (Vxl,...,VXn) 


1.3  Stochastic  Differential  Equation 

Given  a  n-dimensional  stochastic  process  on  t  >  to,  a  typical  Ito-Doob  type  stochastic  differential 
equation  is  given  by 

dx  =  n(t,x)dt  +  cr(t,x)dW(t),  x(to)  =  xo,  (1.1) 

where  fj,  :  M  x  Mn  — >  Mn;  a  :  M  x  Mn  ->  Mnxm  and  W(t)  =  Wm(t))T  is  a  standard 

Wiener  process  on  a  filtered  probability  space  (f l,  Ft,  (J^i'jtxo-  P)*  the  filtration  function  (Wj/yo 
is  right-continuous,  and  each  J 7t  with  t  >  0  contains  all  P-null  sets  in  Ft-  We  say  //  is  the  drift 
coefficient  while  a  is  the  diffusion  coefficient. 

Next,  we  state  the  Ito-Doob  Lemma. 

THEOREM  1.1  Let  u  be  a  continuous  map  from  M  X  Mn  — >  M  such  that  u(t,x )  has  continuous 
partial  derivatives  up  to  second  order  in  x  and  to  first  order  in  t,  then  the  process  u(t,x(t))  also 
has  an  ltd-Doob  differential,  and 

du(t,x )  =  Lu(t,x)dt  +  uxa(t,x)dW(t)  (1.2) 

where  L  is  a  differential  operator  defined  by: 

Lu(t,x)  =  ut(t,x)  +  ux(t,x)p(t,x)  +  ^ trace  (crT(t,  ut(t, x))uxx(t, x)a(t,  ut{t, *)))  .  (1.3) 
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The  following  theorem  concerns  the  classical  existence,  uniqueness  and  certain  other  properties 
of  the  solution  of  (1.1). 

THEOREM  1.2  [79]  Assume  that  there  exist  two  positive  constants  K  and  K  such  that 

•  (Lipschitz  condition ):  for  all  x,  y  £  Mn  and  t  £  [to,  T] 

||q(i,x)  —  p(t,y)\\2  V  ||cr(f,Jf)  —  a(t,y)\\2  <  K\\x  -  y\\2\ 

•  (Linear  growth  condition):  for  all  (t,x)  £  [to,T]  X  Mn 

\\p(t,x)\\2  V  \\a(t,x)\\2  <  K(1  +  ||.*:||2)  , 

where  V  is  the  max  symbol.  Then  there  exists  a  unique  solution  x(t)  to  (1.1). 

In  the  following,  we  state  a  result  that  exhibits  the  existence  of  non-linear  stochastic  differential 
equations. 

Theorem  1.3  [[57],  Thm  3.5 [  Suppose  that  the  local  solution  of  (1.1)  exists  on  every  cylinder 
[to,  oo)  x  Un,  where  Un  =  {jt  £  Mn  :  ||x||  <  n}.  Moreover,  suppose  that  there  exists  a  nonnegative 
function  V  £  C\2  such  that  for  some  constant  c  >  0 

LV  <  cV 

<  (1.4) 

Vn  =  inf  V(t,x)  — >•  oo  as  n  — >  oo, 

||jr||>n 

where  the  L-operator  is  defined  in  (1.3).  Then,  for  every  random  variable  x(to)  independent  of  the 
process  Wi(t )  —  Wi(tf),  there  exists  a  solution  x(t)  of  the  system  of  stochastic  differential  equation 
(1.1)  which  is  almost  surely  continuous  stochastic  process  and  is  unique  up  to  equivalence. 

1.4  Behavior  of  Delayed  Process 

Consider  a  nonlinear  delayed  integro-differential  equation  of  the  form 

—j^-=cv(t)  +  (3  J  v(t  +  s)ds.  (1.5) 

In  order  to  find  approximate  solution  representation,  we  need  to  investigate  the  behavior  of  (1.5). 
For  this  purpose,  we  present  a  result  regarding  its  solution  process.  Our  result  is  based  on  results  of 
[64]  and  [62], 
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DEFINITION  1.4.1  A  non-constant  solution  v(t)  of  (1.5)  is  said  to  be 

•  oscillatory  ifv(t )  has  arbitrary  large  number  of  zeros  on  M+  =  [0,  oo),  that  is,  there  exists  an 
unbounded  sequence  {tn  £  M+}  such  that  v(tn)  =  0. 

•  noil-oscillatory  ifv(t )  is  not  oscillatory,  that  is,  there  exist  a  positive  number  T  such  that  v ( t ) 
is  either  positive  or  negative  for  all  t  >T. 


Following  the  definition  in  [91], 


DEFINITION  1.4.2  The  stochastic  integral  with  respect  to  Brownian  motion  W  (t)tgR+  of  any  simple 
predictable  process  u  :  R+  xSl^R  of  the  form 

n 

u(t,w)  =  f£M+,  (1.6) 

i=l 


is  defined  by 


r(t)dW{t)  =  YjFi(W{ti)  -  W{U- 1)), 


(1.7) 


i=  1 


where  Fi  is  an  Ft measurable  random  variable  for  i  =  1, ...,  n,  u(t)  =  u(t,  w). 


In  the  following,  we  state  a  result  that  exhibits  the  existence  of  solution  of  system  of  non  linear 
equations.  For  the  sake  of  easy  reference,  we  shall  state  the  Implicit  function  theorem  without  proof. 


Theorem  1.4  Implicit  Function  Theorem[2]  Let  F  =  { F\ .  /T, ....  Fq)  be  a  vector-valued  func¬ 
tion  defined  on  an  open  set  S  £  Rq+k  with  values  in  M9.  Suppose  F  £  C\  on  S.  Let  (wo;  Vo)  be  a 
point  in  S  for  which  F(uo]Vo)  =  0  and  for  which  the  q  X  q  determinant  det  [DjFi(uo]  Vo)]  fi  0. 
Then  there  exists  a  k—  dimensional  open  set  Tq  containing  Vo  and  unique  vector-valued  function  g, 
defined  on  Tq  and  having  values  in  M9,  such  that  g  £  C\  on  Tq,  g(vo)  =  Uq,  and F(g(v)',v)  =  0  for 
every  v  £  Tq. 
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Chapter  2 

Linear  Stochastic  Modeling  of  Energy  Commodity  Spot  Price  Processes  with  Delay  in 

Volatility 


2.1  Introduction 

In  real  world  situations,  the  expected  spot  price  of  energy  commodities  and  its  measure  of  variation 
arc  not  constant.  This  is  because  of  the  fact  that  a  spot  price  is  subject  to  random  environmental  per¬ 
turbation.  Moreover,  some  statistical  studies  of  stock  price  [8]  raised  the  issue  of  market’s  delayed 
response.  This  indeed  causes  the  price  to  drift  significantly  away  from  the  market  quoted  price.  It  is 
well  recognized  that  time-delay  models  in  economics  [41,  56,  123]  arc  more  realistic  than  the  mod¬ 
els  without  time-delay.  Discrete-time  stochastic  volatility  models  [9,  38]  have  been  developed  in 
economics.  Recently,  a  survey  paper  by  Hansen  and  Lunde  [46]  has  estimated  these  types  of  models 
and  concluded  that  the  performance  of  the  GARCH(1,1)  is  better  than  any  other  model.  Further¬ 
more,  Cox-Ingersoll-Ross(CIR)  developed  a  mean  reverting  interest  rate  model  that  was  based  on 
the  mean-level  interest  rate  as  exponentially  weighted  integral  of  past  history  of  interest  rate  and  the 
relationship  between  level  dependent  volatility  and  the  square  root  of  the  interest  rate  [19].  Employ¬ 
ing  the  Ornstein  Uhlenbeck  [126]  and  Cox-Ingersoll-Ross(CIR)  [19]  processes,  Heston  developed 
a  stochastic  model  for  the  volatility  of  stock  spot  asset.  Recently  [51],  a  continuous  time  stochastic 
volatility  models  have  been  generalized. 

In  this  work,  using  basic  economic  principles,  we  systematically  develop  both  deterministic  and 
stochastic  dynamic  models  for  the  log-spot  price  process.  In  addition,  by  treating  a  diffusion  coeffi¬ 
cient  parameter  in  the  non-seasonal  log-spot  price  dynamic  system  as  a  stochastic  volatility  function 
of  log-spot  price,  a  stochastic  model  for  interconnected  system  of  log-spot  price,  expected  log-spot 
price  and  hereditary  volatility  process  is  developed.  Introducing  a  numerical  scheme,  a  time-series 
model  is  developed  and  it  is  utilized  to  estimate  the  system  parameters.  The  organization  of  this 
study  is  as  follows: 

In  Section  2.2,  we  develop  a  stochastic  interconnected  models  for  energy  commodity  spot  price 
and  give  an  illustration  by  analyzing  Henry  Hub  Natural  gas  daily  Spot  price  from  1997  to  201 1.  In 
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Section  2.3,  we  obtain  closed  form  solutions  of  the  log  of  spot  and  the  expected  log  of  spot  prices.  In 
Section  2.4,  by  outlining  the  risk-neutral  dynamics  of  price  process,  sufficient  conditions  arc  given 
to  ensure  that  the  risk-neutral  dynamics  of  our  model  is  equivalent  to  the  developed  model  in  Section 
2.2.  Furthermore,  it  is  shown  that  the  mean  of  the  square  of  volatility  under  the  risk-neutral  measure 
is  a  deterministic  continuous-time  delay  differential  equation.  In  addition,  sufficient  conditions  arc 
also  given  to  investigate  both  the  oscillatory  and  non-oscillatory  behavior  of  the  expected  value  of 
square  of  volatility  [62,  64]. 


2.2  Model  Derivation 


We  denote  S(t)  to  be  the  spot  price  for  a  given  energy  commodity  at  a  time  t.  Since  the  price 
of  energy  commodity  are  non-negative,  to  minimize  ambiguity  and  for  the  sake  of  simplicity,  it  is 
expressed  as  an  exponential  function  of  the  following  form; 


S{t)  =  exp  (x2{t)  +  f{t)) , 


(2.1) 


where  x2  it)  stands  for  the  nonseasonal  log  of  the  spot  price  at  time  t,  f(t)  is  the  price  at  t  influenced 
by  the  seasonality  and  it  is  considered  as  a  Fourier  series  comprising  of  linear  combinations  of  sine 
and  cosine  functions; 


N 


f(t)  =  A0  +  ^2  (  Ak  cos 


fc=l 


2nkt 

P 


+  Bk  sin 


27T  kt 
P 


(2.2) 


where  P ,  Aq,  Ak,  Bk,  k  =  1...N  are  all  constant  parameters.  P  is  the  period  which  represents  the 
number  of  trading  days  in  a  year.  Without  loss  in  generality,  we  choose  N  =  2.  By  modeling  the 
seasonal  term  this  way,  we  are  able  to  account  for  the  peak  season  high  price  and  off  peak  season 
low  price  of  gas. 

We  present  the  dynamics  for  the  spot  price  process. 


2.2.1  Deterministic  Non-Seasonal  Log-Spot  Price  Dynamic  Model 

Under  the  basic  economic  principle  of  demand  and  supply  processes,  the  price  of  a  energy  com¬ 
modity  will  remain  within  a  given  finite  upper  bound.  Let  k  >  0  be  the  expected  upper  limit  of 

x2(t). 

In  a  real  world  situation,  the  nonseasonal  log  of  spot  price  is  governed  by  the  spot  price  dynamic 
process.  This  leads  to  a  development  of  dynamic  model  for  the  nonseasonal  process  x2  (t).  In 
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this  case,  n  —  X2 (t)  charactcri/cs  the  market  potential  for  X2 (t)  per  unit  of  time  at  a  time  t.  This 
market  potential  is  influenced  by  the  underlying  market  forces  on  the  nonseasonal  log  of  spot  price, 
X2 (t).  This  leads  to  the  following  principle  regarding  the  dynamic  of  non-seasonal  log-spot  price 
process  of  energy  goods.  The  change  in  nonseasonal  log  of  spot  price  of  the  energy  commodity 
Ax2  (t)  =  X'2  ( t  +  At)  —  X'2  (t)  over  the  interval  of  length  |  At  |  is  directly  proportional  to  the  market 
potential  price. 

Ax2 (t)  oc  (k  —  X2(t))At.  (2.3) 

This  implies 

dx2(t)  =  7(k  -  X2(t))dt,  (2.4) 

where  7  is  a  positive  constant  of  proportionality,  dx2(t )  and  dt  are  differentials  of  X2 (t)  and  t 
respectively.  From  this  mathematical  model,  we  note  that  as  the  nonseasonal  log  price,  X2  (t)  fall 
below  the  expected  price  k,  k  —  x2{t)  is  positive.  Hence  X2 (t)  is  increasing  at  the  constant  rate  7 
per  unit  size  of  k  —  X2 (t)  per  unit  time.  On  the  other  hand,  if  the  nonseasonal  log  price  x2(t)  is 
above  the  expected  price  k,  then  k  —  X2  (t)  is  negative  and  hence  X2  (t)  decreases  at  the  rate  7  per 
unit  size  per  unit  time. 

From  (2.3),  we  note  that  the  steady-state  or  equilibrium  state  nonseasonal  log  of  spot  price  is 
given  by 

x*2  =  k.  (2.5) 

In  the  real  world  situation,  the  expected  price  of  the  nonseasonal  log  spot  price  k  is  not  a  constant 
parameter.  Therefore,  we  consider  the  expected  nonseasonal  log  of  spot  price  to  be  the  mean  of 
nonseasonal  log  spot  price,  X2 (t),  at  time  t  denoted  by  x\ (t).  Under  this  assumption,  (2.4)  reduces 
to 

dx2{t)  =  t(x'i  (t)  -  x2{t))dt.  (2.6) 

Moreover,  in  order  to  preserve  the  equilibrium  of  nonseasonal  log  spot  price  (n  =  x2),  we  further 
assume  that  the  mean  of  nonseasonal  spot  price  process  is  operated  under  the  principle  described  by 
(2.3). 

Axi(t)  oc  (k  —  x\(t))At  (2.7) 

and  hence 

dx\{t)  =  /i(ft  —  x’i  (t))dt,  (2.8) 
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where  /i  is  a  positive  constant  of  proportionality.  From  (2.6)  and  (2.7),  the  mathematical  model  for 
the  deterministic  nonseasonal  spot  price  process  is  described  by  the  following  system  of  differential 
equations: 


dx\{t)  =  h(k  —  xi(t))dt, 
dx2(t )  =  7(.xi(t)  -  x2(t))dt. 


(2.9) 


2.2.2  Stochastic  Non-Seasonal  Log-Spot  Price  Dynamic  Model 

We  note  that  in  (2.3),  n  is  not  just  the  time- varying  deterministic  log  of  spot  price,  instead  it  is  a 
stochastic  process  describing  random  environmental  perturbations  as  follows: 


k  =  x\{t)  +  e2(t)  (2.10) 

where  x\  (t)  is  the  deterministic  part  and  e2(t)  is  the  stochastic  white  noise  process.  From  this,  (2.4) 
becomes 

dx2(t )  =  7(2 q(f)  +  e2{t)  -  x2(t))dt 

=  7(xi(f)  -  x2(t))dt  +  je2(t)dt  (2.11) 

=  j(xi (t)  -  x2(t))dt  +  a(t,  x2(t))dW2{t) . 
where  a(t,  x2(t))dW2{t)  =  'ye2(t)dt  and  dW2{t)  ~  J\f{ 0,  dt). 

Following  the  argument  used  in  the  derivation  of  (2.11),  the  dynamic  from  (2.7)  reduces  to 


dx\(t)  =  h{k  —  x\ (t))dt  +  5dW\(t) 


(2.12) 


where  5  >  0  is  a  constant  and  dW\{t)  ~  A7(0,  dt). 

From  (2.12)  and  (2.11),  the  mathematical  model  for  the  stochastic  nonseasonal  spot  price  process 
is  described  by  the  following  system  of  differential  equations: 


dx\  =  h(k  —  x\  )dt  +  5dWi(t), 

dx 2  =  y(xi  -  x2)dt  +  a(t,  x2)dW2(t). 


(2.13) 


2.2.3  Continuous  Stochastic  Volatility  Model  with  Delay 

When  considering  energy  commodities,  the  measure  of  variation  of  the  spot  price  under  random 
environmental  perturbation  is  not  predictable,  because  it  depends  on  nonseasonal  log  of  spot  price. 
Bernard  and  Thomas  [8]  in  their  work  raised  the  issue  of  market’s  delayed  response.  They  observed 
changes  in  drift  returns  that  leads  to  two  possible  explanations.  First  explanation  suggests  that  a 
part  of  the  price  response  to  new  information  is  delayed.  The  second  explanation  suggests  that 


researchers  fail  to  adjust  fully  a  raw  return  for  risks,  because  the  capital- asset-pricing  model  used 
to  calculate  the  abnormal  return  is  either  incomplete  or  incorrect  estimation.  In  this  study,  we 
incorporate  the  past  history  of  nonseasonal  log  of  spot  price  in  the  coefficient  of  diffusion  parameter, 
that  is,  the  volatility  a(t,x2{t))  of  the  spot  price  follows  the  GARCH  model  [140].  It  is  assumed 
that  the  measure  of  variation  of  random  environmental  perturbations  of  x\(t)  is  constant.  Under 
these  assumptions,  we  propose  an  interconnected  mean-reverting  non-seasonal  stochastic  model  for 
mean  log-spot  price,  log-spot  price,and  volatility  as  follows: 


dx  1 
dx2 

d<x2(f,  x2) 


where 


h(k  —  xi)dt  +  8dWi(t)f  xi(t0)  =  x0i 
7(27  -  x2)dt  +  a(t,  x2)dW2(t),  x2(fo)  =  ^02 
a  +  /3  f*_T  a(s,X2)e~l{t~s',dW2(s)  +  6  f*_T^>(s,t)dW1(s ) 

+  C£J2(f,X2)]  dt, 


(2.14) 


(j)(a,  b)  =  (e  ^  —  e  “))  ,  7,  /i  are  defined  in  (2.4)  and  (2.8),  a,  b  E  M.  (2-15) 
For  the  sake  of  completeness,  we  assume  the  following 

Hi  :  x2t{0)  =  x2(t  +  9),  9  €  [— r,  0],  7,  /a,  5  €  M+,  a,  (3,  c  are  in  M,  (we  will  later  show  that 

— 2  <  c  <  0),  a  :  [0,  T]  x  C  — >  M  is  a  continuous  mapping,  C  is  the  Banach  space  of  continuous 
functions  defined  on  [— r,  0]  into  M  and  equipped  with  the  supremum  norm;  It  )  (t)  and  W2(t)  arc 
standard  Wiener  process  defined  on  a  filtered  probability  space  (Q,  7-)  ,  V),  the  filtration 

function  (Jr)r>o  is  right-continuous,  and  for  t  >  0,  Tt  contains  all  P-null  sets.  We  know  that 
system  (2.14)  can  be  re-written  as 

dx  =  [A  x  +  p]  dt  +  ^(f,x2)  dW(t),  x(t0)=xo,  (2.16) 

where 


x(t)  = 

Xl(t) 

,  A  = 

— /i  0 

,  p  (0  = 

flK 

,  5^(t,ar2(t))  = 

8  0 

X2  (t) 

7  -7 

0 

0  a(t,x2(t)) 

W  (t) 


W\ 

X()\ 

,  x0  = 

w2 

X02 
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Moreover,  (2.16)  can  be  considered  as  a  system  of  nonlinear  Ito-Doob  type  stochastic  perturbed 
system  of  the  following  deterministic  linear  system  of  differential  equations 

dx  =  Axdt.  (2.17) 

In  the  following,  we  present  an  illustration  to  justify  the  structure  of  log  spot  price  dynamic  model. 

2.2.4  Illustration 

We  present  an  illustrate  the  above  described  interconnected  stochastic  dynamic  model  for  non- 
seasonal  log  spot  price  of  energy  commodity  under  the  influence  of  random  perturbations  on  mean- 
level  and  delayed  volatility. 

We  consider  the  Henry  Hub  Natural  Gas  Daily  spot  price  from  1997  to  2011. 


Henry  Hub  Natural  Gas  Daily  Spot  Prices 
(1997-2010) 


Figure  1.:  Plot  of  Henry  Hub  Daily  Natural  Gas  Spot  Prices,  1997-201 1 


We  can  clearly  see  that 

•  Prices  appear  as  being  randomly  driven  and  clearly  non-negative 

•  There  is  a  tendency  of  spot  prices  to  move  back  to  their  long  term  level  (mean  reversion). 

•  There  are  sudden  large  changes  in  spot  prices  (jumps/spikes). 


There  is  an  unpredictability  of  spot  price  volatility. 


A  summary  of  the  statistics  is  presented  in  Table  1  below.  We  find  that  In 


S(t+ 1) 
S(t) 


has  the  smallest 


variance.  Thus,  it  suggests  a  good  candidate  for  our  modeling.  Hence,  we  use  the  logarithmic  price, 
rather  than  the  raw  price  data  for  our  model. 


10 


Table  1:  Descriptive  statistics  of  Henry  Hub  daily  natural  gas  spot  prices,  1997-2010 


Mean 

Variance 

Skewness 

Kurtosis 

Minimum 

Maximum 

St 

4.9519 

2.4966 

1.0391 

4.3491 

1.05 

18.48 

^9 

+ 

1 

<$9 

-0.0001142 

0.3189 

-0.7735 

191.8911 

-8.01 

6.50 

ln(St) 

1.4754 

0.5048 

-0.0465 

2.1540 

0.0488 

2.9167 

H^r) 

2.8485e-5 

0.0473 

0.4814 

22.0473 

-0.56 

0.5657 

2.3  Closed  Form  Solution 


In  this  section,  we  find  the  solution  representation  of  (2.16)  in  terms  of  the  solution  of  unperturbed 
system  of  differential  deterministic  (2.17).  This  is  achieved  by  employing  method  of  variation  of 
constants  parameter  [70]. 


Theorem  2.1  ( Closed  Form  Solution ) 

Let  x(t)  =  x(t,to]Xo)  and  y(t,to]Xo)  =  4>(f,  to)*o  he  the  solutions  of  the  perturbed  and  unper¬ 
turbed  system  of  differential  equations  (2.16)  and  (2.17)  respectively.  Then 


x{t) 


g  /x(t  to)  Q 


*o  + 


k  (l  —  e  *°)) 


5e~t^t~s')dWi(s) 

5f(s,  t)dWi(s)  +  a(s ,  X2{s))e~1^t~sh  dW2{s) 


(2.18) 


where 


xo 


xqi 

XQ2 


w(a,  b)  =  k 


l  _  g-7 (b~a) 


a,  b  G  M. 


and  <f>  is  defined  in  (2.15);  the  fundamental  solution,  4>(t)  of(  2.17)  is  given  by 


(2.19) 

(2.20) 


$(Mo) 


e-u{t-to)  o 

e~7(t-to) 


(2.21) 


Proof.  The  result  follows  by  imitating  the  eigenvalue  type  method  described  in  [69,  70].  Therefore 


Xl(t)  =  e-M(i-io)Xoi  +  «  (l  -  e-Kt-io)^  +S  J*  e-M-^dWxis) 


(2.22) 
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X2(t)  =  <j)(t0,t)x0i+e  7(f  to^x02+uj(to,t)+d  f  4>(s,t.)dWi(s)+  (  a(s,x2(s))e  7(4  s)dW2(s). 

Jto  Jto 

(2.23) 

□ 

In  the  following,  we  present  the  statistical  properties  of  the  solutions  (2.22)  and  (2.23). 


THEOREM  2.2  Under  the  hypothesis  of  Theorem  2.1,  we  have 


E[x(f)]  = 

var[x(t)]  = 


o-nd-to) 


-^o  + 


k  (1  - 

u(t0,t) 


Moreover, 


Hence, 


5 2  ft[  e-W-^ds 

Jt0  E(cr2(s,  x2(s)))e-2^t~sUs  +  62  f*o  <j>2(s ,  t)ds 


lim  E[jc(i)]  = 


t— ¥00 


K 

K 


lim  var[x(t)]  = 

t—>  OO 


Sf 

2  fj, 

i;n,  E(a2(t,X2[t)))  ,  Sf 

ti™  27  +  ^ 


M+7 


lim  E[xi(t)] 

t— >oo 

lim  var{x\{t)) 

t—>  OO 


lim  E[x2(*)]  =  k, 

t— >OC 

5 2 

2  p 


Proof.  From  (2.18),  we  observe  that 


Hence, 


E  [*(*)]  = 


o  ^'(j'  ^0) 


e  7(t  to) 


Xo  + 


k  (l  —  e  ^  to )) 
u(t0,t) 


E(xi(f))  =  x0ie-^-to)  +  k  (l  - 
E  (x2(t))  =  xo2e~li't~t°'>  +  <j)(to,  t)xoi  +  co(to,  t) 
var  (xi (t))  =  52  f  e~Mt-s)ds  =  [l  -  e-2A*(t-to) 

Jt0  2F  l 

var  (x2(t))  =  f  E(<t2(s, x2(s)))e~2'y(t~s^ ds  +  S2  f  f2(s,t)ds. 

Jto  Jto 


The  result  follows  by  taking  the  limits  as  t  — >  oo. 


□ 
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Remark  1  From  Theorem  2.2,  we  observe  that  on  the  long-run,  the  mean-level  of  (f)  and  x\  (f) 
are  the  same  and  it  is  given  by  k. 


2.4  Risk-Neutral  Dynamics  and  Pricing 


In  order  to  minimize  the  risk  of  usage  of  mathematical  model  (2.16),  we  incorporate  the  risk  neutral 
measure.  From  the  dynamic  nature  of  (2.16),  it  is  known  [20]  that  this  model  has  affine  multi-factor 
structure.  In  the  following,  we  present  a  risk  neutral  measure  induced  by  this  type  of  model.  This 
indeed  leads  to  a  risk  neutral  dynamic  model  with  respect  to  (2.16).  Christa  Cuchiero,  [20],  showed 
in  their  work  that  the  market  price  of  risk  0(f)  =  (@i(t), ...,  0n(t))  with  respect  to  the  stochastic 
differential  equation  (1.1)  is  given  by 


0i(t) 


_  r(f) 

P(t,T)  .  _ 


(2.24) 


P(t,T) 

where  P(t ,  T)  =  G(t.  x)  is  the  zero-coupon  bond  price,  r(t)  is  the  short-term  rate  factor  for  the 
risk-free  borrowing  or  lending  at  time  f  over  the  interval  [f ,  f  +  dt\,  and  r/(f.  x /  ) ,  £(f,  x)  are  defined 
by 


=  L  G(t,x), 

((t,x)  =  ^g^cr(f,x), 


(2.25) 


where  G>Gg*’x')  is  the  gradient  of  G,  and  the  L-operator  is  defined  in  (1.3).. 

In  fact,  since  our  price  model  X(f)  =  (xi(t),X2(t))T  (2.16)  is  an  affine  multi-factor  model,  the 
short-term  rate  factor  r(t)  and  the  zero-coupon  bond  price  Pit,  T)  can  be  represented  as 


r(t)  =  g  +  hX(f) 

P(t,T )  =  exp  (a(f ,  T)  +  B(t,  T)X(f)) , 


(2.26) 


where  g  G  M,  h  G  M2,  a(f,T)  and  B(t,T)  =  T),  ^(f,  T), ...,  Bn(t,  T))  are  arbitrary 

smooth  functions.  For  n  =  2,  from  (2.24)  and  (2.25),  the  market  price  of  risk  0(f)  =  (f)\  (t),  O^it)) 
is  given  by 

0(f)  =a  +  b(f)X(f),  (2.27) 
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where 


a 

<22,0  (t) 

<22,1  (t) 

<22,2  (t) 

<21,0  (t) 

<21,1  (t) 
<21,2  (t) 


<2l,0 

<2l,l 

<21,2 

,  X(t)  = 

Xl{t.) 

,  b  = 

<22,0 

<22,1 

<22,2 

X2  (t) 

B2(t,T)cr(t,x) 

' yB2(t,T )  -  hi 
B2(t,T)a(t,x)  ’ 

~7 B2(t,T)  -  h2 
B2(t,  T)a(t,  x) 

\B\{t,  T)5 2  +  /2^i(i,  T)  +  ^  -  g 
Bi{t,T)S 
-gBi(t,T)  -  hi 
B\(t,  T)S  ’ 

0. 


We  incorporate  a  market  price  of  risk  process  that  gives  a  risk-neutral  dynamics  of  the  same  class 
as  (2.16)  in  the  following  lemma. 


LEMMA  2.1  Let  us  assume  that  a  and  Bi,  i  =  1,2  in  (2.26)  are  arbitrary  constants.  The  market 
price  of  risk  processes  reduces  to; 


0i(t) 

=  ai,o  +  aiyxi(t)  +  ap2x2(t) 

(2.28) 

02(t) 

=  a2)0(t)  +  a2y(t)xi(t)  +  a2y2(fi)x2(t). 

(2.29) 

In  addition,  let  us  assume  that  9i,  i  =  1,2  satisfy  the  Novikov’s  condition  [108]  with  the  V -Wiener- 
process; 


Wi(t)  =  Wi(t)  +  f*Q  6i(u)du 
W2(t)  =  W2(t)  +  Jl  02{u)du. 


(2.30) 


and 


hi  +  h2 

=  o, 

02,0  (t) 

=  <21,2  =  0, 

7 

_  hi  -  _  h2 

-  IS2'  0  ~  Ih 

pR 

=  pn  —  $070! 

(2.31) 


where  h\,  h2  are  arbitrary  real  numbers;  p,  n  and  5  are  defined  in  (2.14),  9i,  a,;j,  i  =  1,2, 
j  =  0, 1,  2  are  defined  in  (2.27). 
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Then  the  risk-neutral  dynamics  of  x\  (t)  and  X2  (t)  remain  within  the  same  class, 

cbc  =  [A  x  +p]  dt  +  J2(t,x2)  dW(t),  x(to)=x o  (2.32) 

satisfying  Hi, where 


x(t) 


xi  (t) 
X2  (t) 


A  = 


—/a  0 

7  “7 


»  P(t) 


/IK 

0 


(5  0 

0  a(t,x2(t)) 


W(t) 


lUi 

Xoi 

,  x0  = 

w2 

XQ2 

Moreover,  it  satisfies  Hypothesis  H\.  Hence, 


dx  i  =  p{tt  —  x\)dt  +  SdWi(t), 

dx2  =  f  (xi  ~  x2)dt  +  a(t,X2)dW2(t). 

Proof.  The  proof  follows  by  substituting  (2.30)  and  Ci  into  (2.16). 


(2.33) 

□ 


Remark  2  Under  the  assumption  of  Lemma  2.1,  it  is  obvious  that  the  solution  to  (2.32)  is  given 
by 


x(t)  = 


e-W-V 


Xo  + 


K  (1  -  e-A(t-*o)) 
u(fo,t) 


+/i 

x(f0)  =  X0, 

where  6  and  ui  arc  defined  as 


Se-W-^dWiis) 

8(f>(s ,  t)dWi(s)  +  a(s,  x2(s))e~^t~s^  dW2(s) 


(2.34) 


(f>(a,  b)  =  ^f=  (e-7(6-o)  -  e-Hb-a)^ 
u)(a,  h)  =  R  ( [l  —  e-5(&-“)]  —  < f>(a,  b ))  . 

In  the  following,  we  state  a  result  with  regards  to  (2.34). 


(2.35) 


LEMMA  2.2  Under  the  assumption  Hi,  (2.34)  is  equivalent  to 


e-PT 

0 

x(t  -  t)  + 

«( 1  -  e~^r) 

e-7T 

1 

1 _ 

Se-^-^dWiis) 

5(j)(s ,  t)dWi(s)  +  a(s,  x2(s))e~^(t~s^  dW2(s) 


(2.36) 
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where  x(t  —  r)  = 


x\ (t  -  t ) 
x2{t  -  t ) 

Proof.  The  proof  follows  by  changing  the  initial  time  to  in  (2.34)  tot  —  t.  □ 

Hence, 

®i(t)  =  Xl{t  -  T)e~*T  +  R{1  -  e~*T)  +  5  [  (2.37) 

J  t  —  T 

x2{t)  =  x2(t  -  r)e_7T  +  0(0,  r)®i(f  -  r)  +  w(0,  r)  +  //_T  o(s,  x2(s))e~^t~s^dW2(s)+ 


5  Jt_T<j)(u,t)dWi(u) 


(2.38) 


Remark  3  From  (2.38),  we  have 

//_r  o‘(s,X2(s))e_2(t-s)c(H/2(s)  +  <5  ff_T(f>(u,t)dWi(u )  =  ®2(i)  -  £2(i  -  r)e_7(T) 

-Xi (t  -  t)4>( 0,  r)  -  u>(0,  r). 

(2.39) 


The  dynamics  of  volatility  process  under  risk-neutral  dynamic  system  is  described  by 

ft  ft  i  2 


do  (t,x2)  = 


OL  +  (3 


L  Jt  —  T 


o(s,x2)e  7(f  s')dH/2(s)  +  5  f  4>(s,t)dWi(s) 

J  t  —  T 


+co2(t,x 2)  dt. 


We  set 


n(f)  =  Ep[cr2(f,x2(i))]- 


(2.40) 

(2.41) 

(2.42) 


Taking  the  conditional  expectation  of  both  sides  under  the  measure  V.  we  obtain  the  following 
deterministic  delay  differential  equation 

du(i)  rt  rt 


dt 


=  a  +  (352  f  <f>(s,  t)2ds  +  j3  f  u(s)e  27 ^  +  eu(i) 

*/  t—T  «/  t—T 

=  a  +  /362D  +  (3  f  u(s)e~2^,('t~s^  ds  +  cu(t) 

J  t—T 


where 


D=  cj)(s,t)2ds 

J  t—T 

2  r 


7 


M-7 


1  -27T1 - ^(l-e(/i+7)T)  +  ^r(l-e-2^r) 


^(!-e 
27 


F  +  7 


2/x 


Hence 


du(t) 

dt 


=  cu{t)  +  /3  f  u(s)e  27 ^  +  17 

J  t—T 


(2.43) 
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where 


v  =  a  +  /352D. 


Remark  4  The  equilibrium  solution  process  u*(t)  of  (2.43)  satisfies  the  following  integral  equa¬ 
tion 

cu*(t)  +  /3  f  u*(s)e~2^^~s^ds  +  v  =  0,  (2.44) 

J  t—T 

since  dud^  =  0.  In  particular,  u*(t)  is  as  follows; 


u*{t) 


V 

c+|(l-e-27T) 


Using  the  transformation 


v(t)  =  u(t )  —  u*(t ) 


(2.45) 


we  have 

cu*(t)  +  j3  f  u*(s)e~2^(t~s^ds  +  v 
J  t—T 

=  cv(t)  +  (3  f  v(s)e~2^t~s^ds. 

J  t  —  T 

Hence, 

~~j~~  =  cv(t)  +  /3  J  v(t  +  s)e2^sds.  (2.46) 

In  order  to  find  approximate  solution  representation,  we  need  to  investigate  the  behavior  of  (2.46). 
For  this  purpose,  we  present  a  result  regarding  its  solution  process.  Our  result  is  based  on  results 
of  [62]  and  [64].  Using  definition  1.4.1,  we  prove  the  following  Lemma  using  the  definition  of 
oscillatory  and  non-oscillatory  solution  of  (2.46). 


dv(t ) 
dt 


=  cv(t )  +  (3  f  v(s)e  27^  S^ds  + 
J  t—T 


LEMMA  2.3  Under  the  following  transformation 

v{t)  =  ectz{t ),  (2.47) 


(2.46)  is  equivalent  to 


Moreover, 


e(c+27  )sz(t  +  s)ds. 


(2.48) 


•  (i)for  (3  <  0  and  e  (C+2')')T  —  1  <1,  every  solution  o/(2.46)  is  non-oscillatory. 
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•  (ii)  for  /3  <  0  and  -^=  [e  (c+27)t  _  e  (0+27)1  j  >  L  g  (0,r)  every  solution  of  (2 .46) 
oscillates. 

•  (Hi)  for  /3  >  0,  (2.46)  has  non-oscillatory  solutions. 


Proof.  To  prove  (i),  suppose  that 


/3t 


0-(c+27)t 


-  1 


<-,  P<o, 

e 


(2.49) 


c  +  27 

We  observe  that  every  solution  of  (2.46)  is  non-oscillatory  if  and  only  if  every  solution  (2.48)  is 
non-oscillatory.  Therefore,  we  only  need  to  show  that  (2.48)  has  non-oscillatory  solution. 

Suppose  that  a  solution  of  (2.48)  has  the  form 


A  t 


z(t)  =  e 


where  A  is  an  arbitrary  constant  which  satisfies  the  equation 


(2.50) 


Define 


A  =  0  e^c+^+x)sds. 


G{  A)  =\  —  /3  e^c+2^+x)sds. 


(2.51) 


(2.52) 


We  show  that  G(X)  has  at  least  one  real  root.  From  (2.49),  (2.50)  and  nature  of  3,  we  note  that 
G(0)  >  0  and  for  any  s  €  [— r,  0], 


G{ A)  <  A  -  3e~Xr  /  eic+2^sds 


r0 

=  -3  I  e^c+2^sds 

<  0  by  (2.49). 


— e  +  exp 


r° 

-er3  J  e^c+2^sds 


Therefore,  (2.51)  has  at  least  one  real  root  A*  that  lies  between  /3e  e(c+2y>sd.ci  and  0,  showing 
that  (2.46)  has  non-oscillatory  solution.  □ 

Next,  we  outline  the  proof  for  Lemma  5  (ii) 

Proof.  Suppose 


3 1 


e-(c+27)r  _  e-(c+27)t 


>  -,  3  <  0,  for  any  t  €  (0,  r). 
e 


(2.53) 


c  +  27 

We  only  need  to  show  that  (2.48)  oscillates.  To  verify  this,  suppose  on  the  contrary  that  z(f)  is  a 
non-oscillatory  solution  of  (2.48).  Then  for  sufficiently  large  to  >  0  and  without  loss  in  generality. 
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z{t)  >  0  for  t  >  ti,  where  t±  =  to  —  r.  Since  f3  <  0,  z  (£)  <  0  for  t  >  t\.  For  any  i  >  0  such  that 
— r  <  —  i  <  0,  from  (2.46)  and  (2.48),  we  have  the  following  inequalities 


z  (t)  <  /3  J  e^c+2^sz(t  +  s)ds,  t  >  t\. 
Hence,  for  any  s  G  (— t,  —i),  t  —  t  <t  +  s  <t  —  t  <  t,  (2.54)  yields 


(2.54) 


z(t)  <  z(t  —  i)  <  z(t  +  s). 


(2.55) 


Define 


.  .  z(t  —  l) 
wit)  =  -1^-J  t  >  t,. 


(2.56) 


Note  that  w(t)  >  1.  Dividing  (2.54)  by  z(t)  and  using  (2.55),  we  have 


*  (f)  P 


e-(c+2'y)h  _  e-(c+27)r 


z(t)  C  +  2y  L 

Integrating  from  t  —  i  to  t,  for  t  >  t\, 

log  z(t)  —  log  z(t  —  i)  — 


W(t)  < 

V  ^  «(<)  J —t  z(t) 


P 


c  +  27 


g-(c+27)t  _  g-(c+27)r 


w(s)ds  <  0, 


'  t—i 


and  hence 


Set 


log  w(t)  > 


P 

c  +  27 


e-(c+27)r  _  g— (0+27)1 


lim  inf  wit)  =  K. 

t— >00 


w(s)ds ,  t  >  t\ 


't—i 


(2.57) 


(2.58) 


Since  m(f)  >  1,  /v  >  1,  hence  /i  is  either  finite  or  infinite.  We  show  next  that  none  of  these  cases 
is  true. 

Case  1.  Assume  K  is  finite.  There  exist  sequence  {tn},  tn  >  t\  3  tn  — >  00  and  w(tn)  -3  K  as 
n  — >  00.  By  integral  mean  value  theorem,  3  cn  G  (tn  —  t,  tn )  such  that 


log  w(tn)  >  (c+27)t  _  e  (c+27)tj 

Define  K\  =  lim  w(cn). 

n— >00 

Noting  that  K\  >  K  and  taking  limits  of  (2.59),  we  have 


log  K  >  _/3t 

K  - 


c  +  27  L 


e-(c+27)r  _  g— (0+27)4 


Since 


log  Ff  1 


max 
K>  1  A 


(2.59) 


(2.60) 


(2.61) 
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the  relation  (2.60)  implies 


/3l 


e-(c+27)r  _  g-(c+27)t 


1 

<  - 
e 


c  +  27  L 

which  contradicts  (2.53).  Hence  K  is  not  finite. 

Case  2.  Assume  that  K  is  infinite,  from  (2.56)  and  (2.58),  we  have 

z{t  —  1) 


(2.62) 


lim 

£—>■00 


z{t) 


=  00. 


(2.63) 


Choose  t*  =  t  —  a,  a  >  0,  such  that  t  —  1  <  f*  <  t  for  t  >  t\.  Integrating  both  sides  of  (2.54) 
from  tt  to  t  and  t  —  /  to  A,  we  have 

rt 


z{t)  —  z(t *)  -  /3  /  e 


(0+27)5 


IJU 


z[u  +  s)du 


ds  <  0,  t  >  t± 


z{t*)  -  z(t  —  1)  -  f3  e 


1: 


0(c+2"f)s 


z{u  +  s)du 


/  t  —  L 


ds  <  0,  t  >  t\ 


(2.64) 


(2.65) 


respectively.  We  observe  that  for  any  u  G  s  G  [— r,  —  t],  u  +  s  <  t  +  s  <  t  —  t,  hence, 

z(t  —  i)  <  z(t  +  s)  <  z(u  +  s),  and  for  any  u  G  [t  —  1. 1*},  u  +  s  <  i*  +  s  <  t*  —  t,  hence 
z(f*  —  i)  <  z(t*  +  s)  <  z(u  +  s).  Hence  (2.64)  and  (2.65)  become 

/3a 


z(t)  +  z[t  —  i) 
z(U)  +  z( t*  -  t) 


c  +  27 
/ 3(i  —  a) 


g-(c+27)r  _  g-(c+27)t 


g-(c+27)r  _  g-(c+27)t 


<  z(t *),  t  >t± 


(2.66) 


<z(t  —  i),  t>t\.  (2.67) 


c  +  27 

Dividing  (2.66)  and  (2.67)  by  z(t)  and  z(f*)  respectively,  and  using  (2.53)  and  (2.63),  we  have 


z{U)  z{t-L ) 

hm  — —  =  hm  - : —  =  00. 

t-*> o  z(t )  t,->o o  z(t *) 

Dividing  (2.66)  by  z(t *)  we  have 


(2.68) 


z(t)  z(t  —  r)  /3a 


z(t„)  z(t„)  c  +  27 

which  contradicts  (2.68)  and  (2.53). 


g-(c+27)r  _  g-(c+27)t 


<1,  t>ti 


(2.69) 

□ 


The  proof  of  Lemma  5(iii)  is  similar  to  that  of  5(i). 

Following  Lemma  2.3,  the  delayed  differential  equation  (2.43)  has  a  non-oscillatory  solution  if 
j3  <  0  and  ~^=  [e~-c+27-)r  —  l]  <  4.  Under  these  condition,  we  can  describe  the  asymptotic 
behaviors  of  solutions  of  (2.43).  Moreover,  we  seek  a  solution  in  the  form  u(t)  =  V’l  + 
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where  ipi,  ^2  and  p  arc  arbitrary  constants.  In  this  case,  the  characteristic  equation  with  respect  to 


(2.43)  is 


h(p)  =  p 


c  —  j3 


1  _  e-(p+27)r 

P  +  27 


=  0. 


From  u(to)  =  uq,  we  obtain 


Vh 

■02 


u 


z/ 


(uo-V'i)e  pt°- 


(2.70) 


(2.71) 


However,  using  numerical  simulation  for  (2.43),  we  observe  that  u(t)  is  asymptotically  stable.  From 
(2.46)  and  (4.43),  the  numerical  scheme  is  defined  as  follows; 


Vi  =  (1  +  cAt  +  /3(Af)2e  +  /3(At)2(v;_2e  ^  +  Vi-3e  67  +  ...  +  2ll) 

Ui  =  Vi  +  u* 

(2.72) 

where  Vi  =  u(£j),  Ui  =  u(ti )  and  {f,}7L1  is  the  time  grid  with  a  mesh  of  constant  size  At,  l  is  the 
discrete-time  delay  analogue  of  r. 

Solution  is  shown  in  Figure  (2). 


Figure  2.:  Solution  of  (2.43)  with  parameters  in  Table  2. 
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Chapter  3 

Parameter  Estimation 


3.1  Introduction 

In  this  chapter,  we  find  an  expression  for  the  forward  price  of  energy  commodity.  Using  the  rep¬ 
resentation  of  forward  price,  we  apply  the  Least-Square  Optimization  and  Maximum  Likelihood 
techniques  to  estimate  the  parameters  defined  in  (2.2)  and  (2.34). 

3.2  Derivation  of  Forward  Price 

Let  Fit,  T)  be  the  forward  price  at  time  t  of  an  energy  goods  with  maturity  at  time  T.  We  define 

F(t,T)  =  Ep(S(T))  (3.1) 

where  S(T)  is  defined  by  (2.1),  the  expectation  here  is  taken  with  respect  to  the  risk  neutral  measure 
defined  in  (2.30). 

Remark  5  At  maturity,  it  is  expected  that  the  forward  price  is  equal  to  the  spot  price  at  that  time 
i.e  F(T,  T )  =  S(T ).  This  is  the  basic  assumption  of  the  risk  neutral  valuation  method. 

From  (2.34),  the  forward  price  F(t,  T)  can  be  expressed  as 

F(t,T)  =  E  p(ST) 

=  Ep  (exp[/(T)  +  x2(T)])  (3-2) 

=  exp  [/(T)  +  e~^('T~t')X2{t)  +  4>{t,  T)x\(t)  +Q(t,T)  +  T (t,T)]  , 
where  T  (t,  T)  is  define  by 

T,  27)  +  Oo  -  ipi)epTg{t,  T,p  +  27)  +  [ ^1  h(t,  T,  fi,  7) 

T(f,  T)  =  exp  - 2 ^ -  , 

and 

h(t,  T,  p, ,  7)  =  (g(t,  T,  27)  -  2 g(t,  T,  p  +  7)  +  g(t,  T,  2/2)) . 
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I  _  g-a(T-t) 

g(t,T,a)  = - ,  for  any  a  G  M  (3.3) 

a 

and  Vh  is  defined  in  (2.71).  Hence 

log  F(t,  T)  =  f(T)  +  e-^T-Vx2(t)  +  0(t1T)x1(t)  +  u(t,T)  +  r(t,T) 

=  f(T)  +  e-^T^(logS(t)-f(t))  +  ^(t,T)Xl(t)+6j(t,T)  +  T(t,T)  (3.4) 
=  A(t,T)  +  B(t,T)x\(t) 

where  A(t,  T)  =  f(T)  +  e-^T~^  (log  5(f)  -  /(f))  +  w(f,  T)  +  T(f,  T)  and  B(t ,  T)  =  </(f ,  T). 

Define 

ei  =  (£,«,<*) 

e2  =  (7  ,a,P,c,T) 

C3  =  (A),Ai,A2,Si,B2) 
e  =  (ei,e2,e3), 

where  e  consists  of  the  risk-neutral  parameters  in  (2.2)  and  (2.34). 

We  can  represent  logF(f,T)  as  log F(f,  T;  e),  xi(f)  =  x\(t;ei),  x2(f)  =  .x2(f;e2),  /(f)  = 

/(*;  e3). 

In  the  following  section,  we  use  the  Least  square  optimization  approach  to  estimate  the  parame¬ 
ters  7,  /i,  R  and  5. 

3.3  Parameter  Estimation  Techniques 

In  this  section,  we  discuss  about  the  estimation  of  parameters  of  the  stochastic  interconnected  mod¬ 
els  for  energy  commodity’s  spot  price  (2.14).  A  numerical  scheme  is  used  to  develop  time-series 
model,  and  using  the  Least  Squares  optimization  and  Maximum  Likelihood  techniques,  we  outline 
the  parameter  estimations  for  our  model. 

3.3.1  Least  Squares  Optimization  Techniques 

For  time  f*,  i  <S  {1,  2, ....  N\  =  1(1,  N),  let  S(tr)  denote  the  historical  spot  price  of  commodity. 
For  fixed  i  6  7(1,  N),  F(tj,  T- )  represent  an  observe  future  price  at  a  time  f,  with  delivery  time  T- 
for  j  e  7(1.  ?!,;).  These  data  values  are  obtainable  from  the  energy  market. 

For  each  given  quoted  time  f*,  we  obtain  x\  (f;  ei)  such  that  it  minimizes  the  sum  of  squares 

ni  r  1 2 

sqdiff XU,  e)  =  E  ilo§  F Th  e)  -  loS  HU,  Tj) \  ,  (3.6) 

3= 1 
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where  log  F(ti,  T J;  e )  is  described  in  (3.4).  Differentiating  (3.6)  with  respect  to  x\  (t;  ei)  and  setting 
the  result  to  be  zero  to  get  the  optimal  value  of  x\ (t;  ei)  as  a  function  of  the  parameter  set,  we  have 


E  [B(U,Tj)  (log  F(U,Tj)  -  AfaTjj) 

xi (f*;e)  =  — - — : - - ,  i€/(l,m),  (3.7) 

E  B(U,Tj) 

3= 1  L  J 

Substituting  this  optimal  value  into  the  initial  sum  of  squares  (3.6),  and  summing  over  the  range 
of  initial  times  {tj}  and  performing  a  nonlinear  least-squares  optimization  as  follows: 

N  ni  2 

sqdiff(e)  =  arg  min  \AU,Ti  +  BUtTiXi(t)(e)  -  log  F(ti,  Tj)]  .  (3.8) 

*= 1  3= 1 

With  the  obtained  e,  {xi(i)}E  {rc2 C^)} ^  and  {St}^  are  easily  computed. 

In  the  case  of  real-world  P -parameters  [7,  //,  k,  <5]  estimation,  the  estimates  of  7  and  n  arc  ob¬ 
tained  using  a  linear  regression  technique  associated  with  the  model  dx 2  =  7 (k  —  X2 (t))dt  + 
adW2(t)  .  (3.7)  contains  an  estimated  hidden  process  xi (U)  which  is  obtained  by  the  least  square 
minimization  approach.  This  estimated  data  is  used  in  a  regression  of  a  one-factor  mean  reverting 
model  dx\(t)  =  //(k  —  X]  (t))  +  8dW\  (t)  to  obtain  estimates  for  /t  and  8.  We  remark  that  this 
procedure  is  very  stable. 


3.3.2  Maximum  Likelihood  Approach 

Now,  by  following  the  approach  in  [140]  and  using  Maximum  Likelihood  approach,  the  time  delay 
and  the  delay  volatility  parameters  a,  (3  and  c  arc  estimated.  Our  model  contains  two  sources 
of  randomness,  that  is,  the  Wiener  process  in  the  equation  for  log  of  spot  price  and  another  Wiener 
process  in  the  equation  for  expected  log  of  spot  price.  Therefore,  the  presented  model  is  an  extension 
of  GARCH  model  [140] 

An  outline  of  the  procedure  is  given  below.  From  (2.40),  we  have  that 

^lt  — 2 -  =  a+/3  j  a(s,  x2)e~^t^dW2(s)  +  8  f  (j>(u,t)dWi(u)  +co2{t,x2).  (3.9) 

We  define  the  discrete-time  analogue  value  l  to  the  continuous-time  delay  r  as  i  =  [|^|],  where 
[|.|]  is  the  floor  function,  A  is  the  size  of  the  mesh  of  the  discrete-time  grid.  Hence,  we  define 


G  —  rTy.iv/. 

Vi  =  i, 


(3.10) 
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where  £,  (  arc  standard  normal  variate.  The  discrete-time  delayed  model  corresponding  to  (3.9)  for 
volatility  is  described  by 


-  i  i2 

+  /3At  ^2  ( £n-ie~ 7*  +  r]n-i(f)( 0,  i ))  + 

_i= 1 


(3.11) 


where  n  =  1,  2,  3, 4, ...,  and  r  =  1  +  c. 
From  (2.39),  we  further  note  that 


f  a(s,x2(s))e  1<yt  s'>dW2(s)  +  <50(s,  f)dFFi(s)  =  x2{t)  -  x2{t  —  r)e  7T 
J  t—T 


-Xi(t  -  t)4>( 0,  r)  -  w(0,  r), 


that  is. 


+  ??n_i0(O,  i)  =  x2(n)  -  X2(n  -  l)e  7i  -  aq(n  -  l)</>(0,  Z)  -  w(0,  Z).  (3.12) 


Define 


P(n)  =  x2{n)  —  x2{n  —  l)e  —  x\{n  —  1)0(0,  Z)  —  w(0,  Z)  ,  (3.13) 


This  together  with  (6.1)  yields 


<y\  =  a  +  /3-Pn  + 


(3.14) 


The  solution  of  difference  equation  (3.14)  is  given  by 


aFn(r)  +  /3Gn(r)  +  Hn(r),  n>l  +  1 


n  <  Z, 


where  for  r  =  1  +  c, 


Fn  =  y.  r‘. 


(3.15) 


(3.16) 


on=  J2  rip 


(3.17) 


t7  —  r-n_;/T2 
tin  —  ^  &l  • 


(3.18) 


We  observe  that  the  series  Fn  in  (3.16)  converges  if  |r|  <  1,  that  is,  |1  +  c|  <  1.  Hence, 


-2  <  c  <  0. 


(3.19) 


From  the  definition  of  en  in  (3.10),  the  probability  density  function  f£n  of  en  is 

1  y2 

fsn{y)=  7=  exp  -—f  . 

v27RTn  L  2(JnJ 


(3.20) 
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Thus  the  likelihood  function  L(a,  3,  c)  of  fe.  n  G  7(1,  N)  for  arbitrary  large  positive  integer  N  is 


L(a,  /3,  c)  =  TT  — = —  exp 
y/2nan 

n=  1 

By  applying  the  Maximum  Likelihood  method,  we  obtain  the  estimates  a(l),  f3(l),  and  r(l)  for 
l  e  1(1,  p)  for  some  arbitrary  p. 

3.4  Some  Results:  Natural  Gas 

In  this  section,  we  apply  our  model  to  the  Henry  Hub  daily  natural  gas  data  set  for  the  period 
02/01/2001-09/30/2004  [25],  The  data  is  collected  from  the  United  State  Energy  Information 
Administration  website  (www.eia.gov).  Using  the  Henry  Hub  daily  natural  gas  data  set,  we  present 
the  calibration  results  of  our  model.  The  parameter  estimates  of  our  model  for  the  value  of  /  =  2 
are  given.  For  this  purpose,  using  a  combination  of  direct  search  method  and  Nelder-Mead  simplex 
algorithm,  we  search  iteratively  to  find  the  parameters  that  maximizes  the  likelihood  function.  All 
codes  are  written  in  Matlab. 

Table  2:  Estimated  Parameters  of  Henry  Hub  daily  natural  gas  spot  prices  [25]  for  the  period 
02/01/2001-09/30/2004. 


7 

M 

k  5  t  a 

/3  c 

1.8943 

1.0154 

1.5627  0.36  0.008  0.433 

-0.07  -1.5 

r 

2(7,2 


(3.21) 


Table  2  shows  the  risk-neutral  parameter  estimates  of  Henry  Hub  daily  natural  gas  data  set  [25]  for  the  period 
02/01/2001-09/30/2004. 

The  next  figure  shows  the  graphs  of  the  real  spot  natural  gas  price  data  set  [25]  together  with  the 
simulated  spot  price  S(t). 
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Real  and  Simulated  Spot  Prices  Real  Spot,  Simulated  Spot  and  Simulated  Mean  Prices 


Figure  3.:  Real,  Simulated  and  Forecasted  Prices. 

Figure  3  (a)  shows  the  graphs  of  the  real  spot  natural  gas  price  data  set  [25]  together  with  the  simulated  spot  price 
S(t).  Figure  3  (b)  shows  and  the  the  graphs  of  the  real  spot  natural  price  data  set  together  with  the  simulated  spot  price 
S(t)  and  the  simulated  expected  spot  price  exp(o:i(t)).  We  notice  that  in  Figure  3  (a),  the  simulated  spot  price  captures 
the  dynamics  of  the  data  set.  This  shows  that  the  simulation  agrees  with  our  mathematical  model.  Another  observation 
is  that  the  simulated  mean  level  seems  to  move  around  the  value  4.80  which  is  close  to  exp(/t)  =  exp(1.5627).  This 
confirms  the  fact  that  R  is  the  equilibrium  mean  level. 


Graph  of  volatility 


Figure  4.:  Simulated  a(t,  (t)). 

Figure  4  shows  the  plot  of  volatility  a(t,  X2  (£) )  with  time.  It  is  clear  from  the  graph  that  the  solution  is  non-oscillatory. 
This  is  because  Lemma  2.3  (i)  is  satisfied  using  the  parameter  estimates  in  Table  2. 


27 


Chapter  4 

Non-Linear  Stochastic  Modeling  of  Energy  Commodity  Spot  Price  Processes  with  Delay  in 

Volatility 


4.1  Introduction 

In  real  world  situation,  the  expected  spot  price  of  energy  commodities  and  its  measure  of  variation 
are  not  constant.  This  is  because  of  the  fact  that  a  spot  price  is  subject  to  both  deterministic  and 
random  environmental  perturbations.  Moreover,  some  statistical  studies  of  stock  prices  [8]  raised 
the  issue  of  market’s  delayed  response.  This  indeed  causes  the  price  to  drift  significantly  away 
from  the  market  quoted  price.  It  is  well  recognized  that  time-delay  models  in  economics  [41]  arc 
more  realistic  than  the  models  without  time-delay.  Continuous-time  and  Discreet-time  stochastic 
volatility  models  [9,  38]  have  been  developed  in  economics.  Elloit  et  al  [37]  developed  a  model 
for  pricing  variance  swaps  and  volatility  swaps  under  a  continuous-time  Markov-modulated  version 
of  Heston’s  stochastic  volatility  model.  Recently,  in  a  survey  work,  Hansen  and  Lunde  [46]  have 
estimated  these  types  of  models  and  concluded  that  the  performance  of  the  GARCH(1,1)  model  is 
better  than  any  other  model.  Furthermore,  Cox-Ingersoll-Ross(CIR)  developed  a  mean  reverting 
interest  rate  model  that  was  based  on  the  mean-level  interest  rate  with  exponentially  weighted  in¬ 
tegral  of  its  past  history,  the  relationship  between  level  dependent  volatility  and  the  square  root  of 
the  interest  rate  [19].  Employing  the  Ornstein  Uhlenbeck  [126]  and  Cox-Ingersoll-Ross(CIR)  [19] 
processes,  Heston  developed  a  stochastical  model  for  the  volatility  of  stock  spot  asset. 

In  this  work,  using  basic  economic  principles,  we  systematically  develop  interconnected  stochas¬ 
tic  nonlinear  dynamic  model  for  the  log-spot  price,  expected  log-spot  price  and  volatility  processes. 
The  effort  is  made  to  utilize  the  developed  interconnected  stochastic  model  to  analyze  the  Henry 
Hub  daily  natural  gas  data  set.  The  by-product  of  this  led  to  the  development  of  discretized  ex¬ 
pected  square  volatility  model  and  a  modification  of  The  Kalman  filter  approach.  This  has  been 
achieved  by  treating  a  diffusion  coefficient  parameter  in  the  non-seasonal  log-spot  price  dynamic 
system  as  a  stochastic  volatility  functional  of  log-spot  price. 
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The  organization  of  this  study  is  as  follows: 

In  Section  4.2,  we  developed  a  stochastic  models  for  energy  commodity’s  spot  price.  We  extend 
the  linear  interconnected  deterministic  and  stochastic  models  in  (2.14)  to  non-linear  interconnected 
deterministic  and  stochastic  models.  In  Section  4.3,  the  derived  model  is  validated.  In  Section 
4.5,  by  outlining  the  risk-neutral  dynamics  and  pricing,  risk-neutral  dynamics  of  presented  model  is 
derived. 

4.2  Model  Derivation 

The  principles  of  demand  and  supply  processes  suggest  that  the  price  of  a  energy  commodity  will 
remain  within  a  given  finite  lower  and  upper  bounds.  Let  k\  >  0  and  re2  >  0  be  the  expected  lower 
and  upper  limits  of  the  nonseasonal  log  of  spot  price,  respectively.  In  a  real  world  situation,  the 
nonseasonal  log  of  spot  price  is  governed  by  the  spot  price  dynamic  process.  In  the  following,  we 
outline  the  development  of  dynamic  model  for  the  nonseasonal  spot  price  processes.  Let  X2  (t)  be 
the  nonseasonal  log  of  spot  price  at  a  time  t.  In  this  case,  k2  characterizes  the  fixed  cost,  (x2 (t)  + 
k;i)(k2  ~  £2 (i))  characterizes  the  market  potential  for  X2 (t)  per  unit  of  time  at  a  time  t.  The  market 
potential  is  induced/generated  by  the  underlying  market  forces  on  the  nonseasonal  log  spot  price, 
X2  (t).  This  leads  to  the  following  principle  regarding  the  dynamic  of  price  X‘>{t)  of  energy  goods. 
The  change  in  nonseasonal  log  spot  price  of  the  energy  commodity  Ax2  (t)  =  X2  (t  +  At)  —  X2  (t) 
over  the  interval  of  length  \At\  is  directly  proportional  to  the  product  of  the  market  potential  price 
and  the  length  of  the  interval. 


A x2(t)  OC  (x2(f)  +  Kl)(n2  -  x2(t))At. 


(4.1) 


This  implies 

dx2{t)  =  7 (x2(f)  +  «i)(k2  -  X2(t))dt,  (4.2) 

where  7  is  a  positive  constant  of  proportionality,  c/.i;2  and  dt  are  differentials  of  x2(i)  and  t,  respec¬ 
tively. 

We  note  that  (4.2)  has  a  unique  non-zero  equilibrium  k2.  Moreover,  we  observe  that  whenever 
the  price  lies  above  ac2,  there  is  a  tendency  for  the  price  to  fall  and  whenever  the  price  is  below  k2, 
the  price  rises  back.  Hence,  k2  is  the  equilibrium  of  (4.2).  Hence 

lim  x2(t)  =  K2  (4.3) 

t — S'- OO 
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In  the  real  world  situation,  the  upper  price  limit  of  the  nonseasonal  log  spot  price  n2  is  not  a  constant 
parameter.  In  the  following,  we  employ  the  argument  of  Bernard  and  Thomas  [8]  to  incorporate  both 
the  response  time  delay  and  random  environmental  perturbations  into  the  measure  of  variation  of 
the  log-spot  price  process  of  energy  commodity.  Therefore,  we  consider 

K2  =  xi  (t)  +  e2(t),  (4.4) 

where  e2  is  a  white  noise  process  that  characterizes  the  measure  of  random  variation  of  the  log 
spot  price,  x\(t)  describes  a  mean  of  non-seasonal  log  spot  price  process  and  it  is  assumed  to  be 
governed  by  a  similar  differential  equation  described  in  (4.2),  that  is, 

dx\(t)  =  /i(xi(£)  +  k3)(k2  -  xi(t))dt,  (4.5) 


where  fj,  is  a  positive  constant  of  proportionality. 

Moreover,  the  mean  non-seasonal  log  spot  process  is  subject  to  random  environmental  perturba¬ 
tions.  By  following  the  argument  used  in  (4.4),  we  assume  that  k3  is  subject  to  random  perturba¬ 
tions: 

«3  =  «o  +  ei,  (4.6) 


where  kq  is  constants,  and  e\  is  a  white  noise  and  it  describes  the  measure  of  random  influence  on 
the  mean  non-seasonal  log-spot  price. 

Substituting  (4.4)  and  (4.6)  into  (4.2)  and  (4.5),  respectively,  we  obtain 


dxi(t.)  =  n(xi(t)  +  ko)(k2  —  xi(t))dt  +  h(k2  —  xi(t))ei(t)dt, 
dx2(t )  =  ry(x2(t)  +  K\)(xi(t)  -  X2(t))dt  +  j(x2(t)  +  K1)e2(t)dt. 


(4.7) 


Using  (4.7)  and  following  the  argument  of  Bernard  and  Thomas  [8],  we  incorporate  both  the 
response  time  delay  and  random  environmental  perturbations  into  the  measure  of  random  variations 
on  the  log-spot  price  process  of  energy  commodity.  This  leads  to  the  establishment  of  a  stochastic 
model  for  nonseasonal  log  spot  price  and  expected  log-spot  price  processes  that  is  described  by  the 
following  non-linear  system  of  stochastic  functional  differential  equations: 


)dx  1  =  n(x\  +  kq){k2  -  X\)dt  +  S(k2  -  xi)dWi(t),  xi(t0)  =  xw, 
dx 2  =  7(22  +  Ki)(xi  -  x2)dt  +  <r(t,X2t)(x2  +  m)dW2(t),  xto2  =  $02, 

where 

J  He\{t)dt  =  8d,W\  (t) 

1  7 e2(t)dt  =  a(t,  x2t)dW2(t), 


(4.8) 


(4.9) 
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and  5  >  0,  X2 1  is  a  segment  of  continuous  function  x'2  defined  by  xi t(9)  =  X2 (t  +  6),  6  6  [— r,  0] 
for  t  >  0,  ex  is  a  functional  defined  on  [0,  T]  x  C[[— r,  0],  M]  into  M. 

For  the  sake  of  validity  and  completeness  of  mathematical  model  (4.8),  we  assume  the  following: 


Hi  :  X2 1(0)  =  X2 (t  +  9),  9  e  [— r,  0],  xt  =  d  G  C[[— r,  0],M2]  defined  as  Xf(0)  =  x(f  +  0)  = 
[xi(t  +  0),  X2(t  +  ^)]T,  t  >  0,  7  >  0,  n  >  0,  K\  >  0,  K2  >  0,  >  0,  5  >  0,  cr  :  [0,  T]  X  C  — >  M+ 

is  a  Lipschitz  continuous  bounded  mapping,  C  is  the  Banach  space  of  continuous  functions  defined 
on  [— r,  0]  into  M  equipped  with  the  supremum  norm;  W\  (t)  and  IF2  (t)  are  standard  Wiener  process 
on  a  filtered  probability  space  (Q,  T .  (Jr)/>o,  V),  the  filtration  function  (F)t>u  is  right-continuous, 
and  each  Ft  with  t  >  0  contains  all  P-null  sets  in  F. 

By  following  the  idea  of  [140],  we  define  the  continuous  volatility  version  of  the  GARCH  type 
model  as: 


da2(t,  i?2)=  ot  +  ca2(t,  i?2)  +  P 


a(s,i!}2)dW3(s) 


't—T 


dt,  a2(t.0,  d02)  =  0-0(1)02)  (4.10) 


where  a,  /3  €  M+,  c  <  0,  and  W3  is  a  Wiener  process.. 

From  (4.8)  and  (4.10),  the  overall  stochastic  dynamic  model  for  nonseasonal  log  spot  price,  ex¬ 
pected  log-spot  price  and  volatility  processes  under  random  perturbation  is  described  by  the  follow¬ 
ing  non-linear  system  of  stochastic  functional  differential  equations 


dx  1  =  n(x\  +  kq)(k2  -  X\)dt  +  5(^2  -  x\)dW\(t),  x1(t0)=xi0, 

dx 2  =  ^(X2  +  Kl)(xi  -  X2)dt  +  (j(t,X2t)(x2  +  Hl)dW2(t),  xto2  =  d 02, 

2 

[  cr2(t0,d02)  =  cr'2(d02). 

4.3  Mathematical  Model  Validation 

In  this  section,  we  validate  the  mathematical  model  derived  in  Section  2.  We  note  that  the  clas¬ 
sical  existence  and  uniqueness  theorem  is  not  directly  applicable  to  (4.8).  We  need  to  modify  the 
existence  and  uniqueness  results.  The  modification  is  based  on  Theorem  3.4  [57]  and  the  usage  of 
lineal-  invertible  transformation.  For  this,  we  first  transform  the  systems  of  nonlinear  stochastic  sys¬ 
tem  of  differential  equations  (4.8)  into  a  geometric  mean  reverting  non-linear  stochastic  systems  of 
differential  equations.  We  show  the  global  existence  of  solution  process  of  transformed  systems  of 


da2(t,d2)  =  [a  +  ca2(t,d2)  +  P  f*_T  cr(s,d2)dW3(s) 


dt , 


(4.11) 
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differential  equations.  From  this,  the  solution  of  the  geometric  mean  reverting  non-linear  stochastic 
system  follows  immediately. 


y  i 

=  X\  -  k2 

V2 

=  X2  +  Kl 

<Pl 

=  $1  -  k2 

<F2 

=  ti2  +  Kl 

Lemma  4.1  Using  the  transformation 

a) . 

b) . 

we  have  dyi(t )  =  dxi(t)  and  hence,  the  system  of( 4.11)  is  reduced  to 

dyi  =  -nyi[Xi  +  yi]dt- SyidWi,  yi(t0)  =  y10, 

d-y 2  =  7J/2[A2  +  yi-  V2 ]dt  +  a(t,  y2t  ~  Ki)y2dW2 ,  yto2  =  <po2 

da2(t,  ip2  —  k\)  =  (^a  +  ca2(t,ip2  -  ki)  + /3  fi_Tcr(s,(p2  -  ni)dW3(s) 

cr2(t0,<F02  -  Kl)  =  CTo(^02), 

where 

/ 

Al  =  K0  +  k2 
X2  =  Kl  +  K2. 


(4.12) 


(4.13) 


1 2\  (4.14) 

dt, 


(4.15) 


In  the  following,  we  give  the  existence  and  uniqueness  conditions  for  solutions  of  the  IVP  (4.14). 

We  recall  that  system  of  stochastic  differential  equations  (4.14)  does  not  satisfy  the  classical 
existence  and  uniqueness  conditions.  However  it  does  satisfy  the  local  Lipschitz  condition.  We 
construct  sequences  of  functions  for  the  drift  and  volatility  parts  of  (4.14)  such  that  the  classical 
existence  theorem  conditions  arc  valid  for  a  sequence  of  modified  rate  coefficients  defined  on  a 
cylinder  [io,oo)  x  Un,  for  fo  €  R,  n  6  {1,2,3,...},  where  Un  arc  modified  sequence  of  rate 
functions  defined  as: 

Un  =  {\y\o<n},  (4.16) 


bi(t,  <Pi(0)) 
b2(t,ip2(0)) 

<  h(t,(p2) 

0)) 

,  <T2(t,(p2) 


-tupi(0)(K0  +  K2  +  <£l(0)) 
7¥,2(0)(<Pi(0)  -  <p2(0)  +  ki  +  k2) 


a  +  ca2(t. ,  ip2  -  K\)  +  13 


Jt-T  a(si  ^2  -  K1)dW3(s) 


S<pi(0) 
<r(t,<p)<P2(  0) 


(4.17) 
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where  p  = 


|o  =  sup  |</?(s)|,  tfi  G  C[[— t,  0],M2],  for  i  =  1,  2,  and 

— T<S<0 


i(0))  = 


O-[M)(t,<y9l(0))  = 


b^n)(t,<p2(0))  = 


bt\t,V2)  =  b3(t,<p2)  v  n 


bi(t,  </?i(0))  for  |<^|0  <  n 
bi(t,  n)  for  \ip\  >  n 

0))  for  |(^|o  <  n 
cri{t,n)  for  |^|0  >  n, 

b2(t,(p2(0))  for  |y?|o  <  n 
b2(t,n )  for  |^|0  >  n 

cr2(t,(p)  for  \(f\0  <n 
<?2{t,n )  for  |</?|o  >  n, 


(4.18) 

(4.19) 

(4.20) 

(4.21) 

(4.22) 


Using  the  sequence  of  functions  (4.18  —  4.22),  the  modified  system  of  stochastic  differential  equa¬ 
tions  (4.14)  is  described  by 

dy[n)  =  b^\t,y[n))dt  + a[n\t,y[n))dWi,  yi(i0)  =  <M0), 

<  dy(2]  =  b^\t,y%l))dt  +  a%l\t,y%))dW2,  y2{t0)  =  ip02,  (4-23) 

da2(f,-i?)(n)  =  b^\t,  y^)dt,  (T2(t0,ip02)  =  (Tq((Po2)- 

Hence,  from  (4.18)-(4.22)  and  assumption  Hi,  system  (4.23)  satisfies  the  classical  existence  and 

(n)  (n) 

uniqueness  conditions  [57].  Therefore,  there  exist  a  sequence  of  Markov  process  y\  and  y2 
corresponding  to  equation  (4.23).  Next,  we  show  that  the  global  solution  of  (4.14)  exists.  For  this 
purpose,  we  need  to  utilize  the  following  concepts. 

DEFINITION  4.3.1  Define  r[r^  and  t 2^  to  be  the  first  exit  time  of  the  process  y[n\t)  and  y2>'1  (t) 
from  the  set  \y±\  <  n  and  \y2\  <  n  respectively,  that  is 

r/n)  =  mi{t  >  0  :  \yi(t)\>n},  *  =  1,2.  (4.24) 

(n) 

Define  T\  and  t2  to  be  the  (finite  or  infinite)  limit  of  the  monotone  increasing  sequence  t}  and 
T-j”'1  respectively  as  n  — »  oo. 

n  =  lim  t-'i)  =  infji  >  0  :  \yi(t)\  0  [0,oo)},  i  =  1,2.  (4.25) 

n— >oo 

A  process  X(t)  is  regular  if  for  any  ( s ,  x)  £  I  X  R1, 


P{t  =  oo}  =  1 


(4.26) 


where  t  is  the  limit  of  the  first  exit  time  rn. 
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Using  Theorems  3.4  and  3.5  of  [57],  we  show  that  the  process  y(f)  =  {y\  it).  y2(t) }  is  regular. 
To  do  this,  we  cite  the  Theorem  and  show  that  the  conditions  in  the  Theorem  arc  satisfied. 


THEOREM  4.1  ( Theorem  3.5)  [57]  Suppose  that  the  local  solution  of  (4. 23]  exists  on  every  cylinder 
[fo,oo)  X  Un  and,  moreover,  that  there  exists  a  nonnegative  function  V  G  C2  such  that  for  some 
constant  c  >  0 

LV  <  cV 

<  (4.27) 

Vn  =  inf  V(t,y )  — »  00  as  n  — >  00, 

1 2/|  >71 


where  the  L-operator  is  given  by 

l 

y 

-U 

dt 


d 2 


dy^dy^ 


(4.28) 


i,j= 1  ^  w  tfj 

Then,  for  every  random  variable  x{tf)  independent  of  the  process  Wft)  —  Wj(to)  there  exists  a  so¬ 
lution  y(t)  of  the  system  of  stochastic  differential  equation  (4.14)  which  is  almost  surely  continuous 
stochastic  process  and  is  unique  up  to  equivalence. 


Proof.  We  utilize  the  structure  of  system  (4.23)  and  establish  the  conclusion  of  the  theorem  for  the 
first  component  of  (4.23),  followed  by  the  second  component  by  knowing  the  nature  of  the  third 
component  of  (4.23)  in  Appendix  A.  1. 

We  define  a  new  stochastic  process  yi(t)  as 

Vi  =  Vil\  for  t  <  r,(n) .  (4.29) 


We  show  that  condition  (4.26)  is  satisfied  for  y\,  thereby  making  the  process  y\(t)  to  be  almost 
surely  defined  for  all  t  >  to. 

We  define  a  nonnegative  function  V\  on  E  =  [to,  00)  x  M+  into  M+  as  follows; 


[ Vl  r,  M(«0  +  «2)  S 2 

Vi(t,yi)=  /  (u2  +  1)  S2  du  4 - ■ - 

Jo  K0  +  k2 


At(«0  +  «2)(1  +  K0  +  K2) 


/J.(K.a  +  K2)  ,  , 
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(4.30) 


52  +  p(k  0  +  k2) 

It  is  obvious  that  V\  €  C\t2.  Moreover,  the  L-operator  with  respect  to  the  first  component  of  system 
of  stochastic  differential  equation  (4.14)  satisfy 


,  .  ,  o  m(«0+"2)  1  9  9  ,  A"0  : 

LVi  =  -/x(k0  +  K2)yi(yj  + 1)  &  -pyf{y[  +  l)  S2 

,  .  .  9  .  .  9  M(K()+K2)  1  „  „  m(kq+<^2) 

<  /i(/€o  +  /«2)(yi  +  l)(yi  +  l)  a2  -pyl(yl  +  T)  «2 


=  mOo  +  «2  -  yi)(yi  +  l) 


ll(Kf)+K2) 
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Case  1:  If  kq  +  «2  —  y\  <  0,  then  LV\  <  0  <  V\. 


Case  2:  If  kq  +  —  y\>  0,  then  —  +  K2  <  yi  <  +  «2  and 


At(«o  +  «2  -  y?)(y?  +  1)  < 


m(kq+k2) 


52 


HQ  +  «2 


Mpfi)  +  «2)(1  +  ^0  +  K2) 
(52  +  /x(k0  +  «2) 


(j(«n+K2)  , 

+1 


,  (4.31) 


M(«Q  +  «2) 


since  the  function  f(x)  =  h(kq  +  K2  —  x2)(x2  +  1)  s2  has  a  maximum  point  at  x  = 

s/*o+>* 

Hence,  LVi  <  Vi. 

Thus,  in  both  cases, 

Furthermore, 


LVi  <  Ci. 


(4.32) 


Vin  =  mf  Vi(t,yi) 

\yi\>n 

„„  .  o  .  M«o+"2)  , 

=  /o  (“  +  f)  du  + 


52 


KQ+K2 


M(KQ  +  K2)(l  +  fvO+K2) 

<52+/j.(ko+K2) 


m(k()  +  k2)  i  i 
52  +1 


To  show  that  yi  (f)  is  regular,  we  define  a  function 


oo  as  n  — >•  oo. 

(4.33) 


fCi(f,yi)  =  Fi(f,yi)exp{— (t  — 10)}, 


(4.34) 


From  (4.32),  we  note  that  LW\  <  0.  By  defining  r\ (t)  =  rnin(r[?t') ,  t)  and  imitating  the  argument 
of  Lemma  3.2  of  [57],  we  have 


E{Vi(Tin\t),yi(rin\t)))  <  e^mito ,yi(t0)). 


Hence 


V{r[n)  <t}< 


e(*-*°)ECi(t0  ,yi(t0)) 

inf  Vi(u,  yi) 
\yi\>n,u>t0 


— >  0  as  n  — ^  oo  by  (4.33). 


(4.35) 


Thus,  using  (4.26)  and  (4.35),  the  global  existence  and  uniqueness  follows  by  letting  n  — >•  oo. 

From  (4.29),  we  conclude  the  global  existence  of  yi(t)  of  (4.14)  which  is  an  almost  surely  unique 
continuous  stochastic  process.  Hence,  using  (4.12)(a),  we  can  also  show  that  there  exist  the  global 
solution  x\(t)  of  sub-system  of  (4.8)  which  is  an  almost  surely  continuous  and  unique  stochastic 
process  . 
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For  the  proof  of  the  global  existence  of  solution  y2{t)  of  the  second  component  of  (4.14),  we 
show  the  existence  of  solution  n2(t,  x2 t)  of  the  third  component.  The  existence  and  uniqueness  of 
cr2(f,  x'2/ )  follows  from  Theorem  A.l  in  Appendix  A.  1. 

For  the  proof  of  the  existence  of  y2,  we  note  that  from  the  boundedness  of  functional  a(t,  $2)  and 
the  minimal  class  of  functions  [72],  we  have 

(4.36) 

for  some  positive  constant  y  >  0.  From  the  proof  of  global  existence  and  almost  sure  stability  of 
first  component  of  (4.14),  we  assume  that 

\yi(t)\  <  M  V  t  >  to  (4.37) 

for  some  positive  constant  M.  For  the  proof  of  the  global  existence  of  1/2,  we  define  a  non-negative 
Lyapunov  function 


ry  2 


V2(t,y2)  =  I  (uz +  1)*?  du+  max  (  7(2/2  +  !)^ 
/Q  J/2G[0,2(Af+Ki+K2)] 


(M  +  +  n2)\y2\  -  -y2 


(4.38) 


The  L-operator  with  respect  to  the  second  component  of  (4.14)  is  given  by 

cr2(t,y2t  -  ki)  .  2 


LF2  =  72/2(2/1  -  2/2  +  *7  +  K2)(y2  +  +7  9??2 

<  72/2(2/1  -  2/2  +  «1  +  K2)(V2  +  +  ^(2/2  +  l)^yl 


{y'2  +  l)^  1y2 


=  7(2/2  +  !)^ 


-\y\  +  2/2(2/!  +  «i  +  «2) 


Case  1:  If  +  y2(2/i  +  «i  +  k2)  <  0,  then  LV2  <  0  <  V2. 


Case  2:  If -\y\  +  2/2(221  +  «i  +  k 2)  >  0,  then  0  <  |y2|  <  2|yi  +  +  k2|. 

Since  continuous  functions  on  closed  intervals  arc  bounded,  then  the  function  f(y2)  =  7(22!  + 

7 

1)  2?A  [—1^2  _|_  y2^y1  +  +  K2)]  is  bounded  on  the  interval  0  <  y2  <  2(M  +  +  /c2).  Hence, 

for  y2  €  [0,  2 (M  +  «i  +  k2)], 


LV2  <  7(2/2  +  !)^ 

<  7(2/2  +  !)^ 

<  c2. 


“2/2  +  2/2(2/l  +  «1  +  «2) 

—  2^2  +  I2/2KM  +  Ki  +  K2) 
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Furthermore, 


V2n  =  inf  V2(t,y2 ) 

(  \y2\>n 

=  /JV  +  1  Wdu+  max  (7 {vl  +  [(M  +  «i  +  n2)y2  -  \y\ ])  . 

2/2^[0?2(A/H-/^i+Av2)]  '  ' 

(4.39) 

It  follows  that  V2n  — )•  00  as  n  — >■  00.  By  defining 

W2 (t,  y2 )  =  U2 (t ,  y2)e-^-t0\  (4.40) 


we  have 


<t}< 


e(t~to)E  V2(t0,y2(t0)) 
inf  V2(u,y2) 

\y2\>n,u>t0 


— >  0  as  n  — >  00  by  (4.39). 


(4.41) 


Thus,  the  global  existence  and  uniqueness  of  solution  of  the  second  component  of  (4.14)  follows 
by  letting  n  ->  00.  Hence,  there  exist  a  global  solution  (yi(t),y2(t))  of  the  system  of  non-linear 
stochastic  equation  (4.14).  □ 


Using  transformation  (4.12),  it  can  be  easily  deduced  that  there  exist  a  global  solution  (.17  (t) ,  x2  (t)) 
of  the  system  of  non-linear  stochastic  system  (4.8). 


4.4  Closed  Form  Solution  Under  V 

We  observe  that  the  system  of  stochastic  non-linear  differential  equations  (4.8)  is  a  Ito-Doob  stochas¬ 
tic  Bernoulli  type  stochastic  differential  equations  [70] 


dy  =  [P(t)y  +  Q{t)yn  +  '-T  '\t)yZn~l\  dt  +  [£(*)*/  +  T (t)yn]  dW(t) 
for  any  n  /  1,  where  P ,  Q.  S  and  T  arc  continuous  functions. 


(4.42) 


To  find  solutions  yi(t)  and  y2(t),  we  imitate  the  procedure  [70]  for  finding  the  implicit-closed 
form  solution  processes  of  first  two  components  of  non-linear  stochastic  differential  equations  in 
(4.14). 

We  consider  an  Energy/Lyapunov  function 


Vj(Uyt) 


l 


for  i  =  1,2,  yi(t)  +  0, 


(4.43) 
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Hence,  applying  Ito’s  formula  to  (4.43),  we  have 


dVi  =  '(//A,  +  52)¥i  +  n\  dt  +  SVidWi(t) 

dV2  =  |(-7(A2  +  yi(t))  +  <72(t,(p2))Y2  +  7]  dt  -  a(t,<p2  -  «i)V2dW2(t). 


(4.44) 


Using  the  techniques  described  in  [70],  the  implicit  solution  to  system  of  differential  equation 


(4.44)  is  given  by 


where 


Vi(i,  yi)  =  (f>i(t,tQ)ci  +  nJ*Q(f>i(t,s)ds 
V2(f,  y2)  =  02(Mo)c2 +  7/*  02(t,  s)ds 


(4.45) 


<MMo)  =  exp  [(/x(k2  +  Ko)  +  \52)  (f  -  to)  +  S(Wi(t)  -  Wi(f0))] 

02  (Mo)  =  exp  (-7(2/1  (s)  +  A2)  +  \o2(s,y2s  ~  «i))  ds  -  /t*  a(s,y2s  -  Ki)dW2(s)  , 


(4.46) 


and  Ci,i  =  1,2  are  constants. 

Comparing  (4.43)  and  (4.45),  we  have 


2/1  (f )  =  <t>\  (t ,  fo)ci  +  fx  //o  0i  (t ,  s)ds 
2/2  (i)  =  02(Mo)c2  +  7  //0  02  (f,  s)ds 


(4.47) 


Hence,  using  transformation  (4.12)  together  with  the  initial  condition  yi(to)  =  7 10  >  0,  y2t0  = 


if02  >  0,  we  have 


x^)=  +  +k2 

X2(t)=  ^SS+7//o02(f,s)ds_  -Ki. 


(4.48) 


Remark  6  It  is  obvious  from  (4.47)  that  m  >  0  for  i  =  1,2.  Also,  0i(t,  to)  is  a  log-normal 
random  variable  log  Af  (  [(/Mo  +  «2)  +  ^2)]  (t  ~  to),  52(t.  —  to))-  Hence 


%>0t(f,  to)  =  exp  [(/Mo  +  K2)  +  d2)(t  -  t0)  . 


(4.49) 


By  Jensen’s  inequality,  we  have 


IEp[|yi(t)|]  >  Ev  +  /r//o0i(t,s)ds) 

=  exP  [M«o  +  M  +  £2)(t  -  to)] 


/i(K0  +  K2)+5^ 


Hence, 


(4.50) 


lirn  Ep  [|yi(t)|]  >  0 

t— >OD 


(4.51) 
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Also,  since 


we  have 


Vi(t)  < 


4>i  (t,  to) 
2/10 


-i 


IEp  [yi(t)]  <  2/io  exp(— ^(k0  +  K2)(t  -  to)). 
Hence,  by  Squeeze  theorem,  from  (4.50)  and  (4.53), 


Consequently,  using  (4.12),  we  have 


lim  Ep  [yi{t)]  =  0. 

t—>  OO 


lim  E p  [xi(t)]  =  k 2- 
t— >00 


(4.52) 


(4.53) 


(4.54) 


(4.55) 


This  establishes  the  fact  that  x\{t)  describes  the  mean  of  non-seasonal  log-spot  price. 

We  can  also  evaluate  the  area  under  the  curve  ijift)  from  to  to  t.  To  do  this,  we  re-write  (4.47)  as 


2/1  (t)  = 

2/2  (t)  = 


01  1  (6*0)3/01 


l+MJ/oi  ft  0i  (s,t0)ds 


02  (6*o)<g02 


(4.56) 


1+7^02  /tQ  02  (s,t0)ds‘ 


It  follows  immediately  that 


[  yi(s)ds  =  -In  1  +  /jy0i  [  (j)11(s,t0)ds 
J  tQ  M  J  t() 

[  y2(s)ds  =  -ln  1  +  7^02/  4>21(s>to)ds 
J  tr\  ^7  J  tn 


(4.57) 

(4.58) 


'  /  L 

Hence,  applying  Fubini’s  theorem,  using  the  concavity  of  logarithmic  function,  and  the  facts  that 


E ■p(j)1  (t,  to)  =  exp  [-/j,(ko  +  k2 )(t  -  f0)] , 
J^Mo)  =  exp  7  //0(Ep[yi(s)]  +  A2)ds 

and  Ep[2/i(£)]  <  r/io  (from  (4.53)),  we  have 

(.-i 


(4.59) 


r* 

)t o  ■ 


f 4 
n0  ■ 


< 

4  In 

< 

4  In 

y 

< 

4  In 

7 

< 

4  In 

1  +  //Ep [i/oi]  /iQ  Ep [01  (s,  t0)]c7s 

1  I  E^bl0]  (l  _  g-/i(KO+K2)(t-to)) 
^  K0+K2  V  / 

1  +  7Ep[<p02]  //oEp[</>21('S,to)]rfs 

1  1  [^02]  (g7(yio+A2)(t-to)  _  1  ) 

1  +  yio+A2  \e  L> 


(4.60) 


In  addition  to  the  above  outlined  results,  we  present  a  few  more  properties  of  y\  and  y2. 
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Theorem  4.2  7/7 


[2/2(7)]  < 


—  ^  >  0,  then 

27  —  T]2 

L  27(^1  +  K2  +  M) 


+  /o- 


27  —  if 


27(^1  +  n2  +  M) 


=-7(Ki+K2 +M)(t-t0) 


-1 


,  (4.61) 


where  M  is  defined  in  (4.37),  where  fo  = 


Proof.  Using  the  fact  that  y 2  >  0,  define  the  Lyapunov  function  v  :  [to,  00)  x 


by 


v(t,y2)  =  y\. 


(4.62) 


Then  from  (4.14) 


dv  =  hvdt  +  2a(t,  y2t)vdW2(f), 


where  the  operator  L  is  define  as 


9  '  9  1  .2,,  ...  \  2 
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L  =  77  +72/2(«i  +  «2  +  2/1  -  2/2)777  +  7^ (7>  2/2t ) 2/2 1772 ■ 


dt  ^'dy2  2 

Using  (4.36)  and  (4.37),  the  operator  L  satisfies 


'#2/2 


Ln  <  —(27  —  if)v 2  +  27(^1  +  k2  +  M)n. 

Define  u(t)  =  Ep(n(f,  y2(t))).  By  applying  Theorem  4.8.1  of  [66],  we  obtain 


E [v(t,  y2(t))]  <  u(t,tQ,uo), 


where  u(t,  to,uo)  is  a  solution  of 


du(t)  =  —(2y  —  if)u 2  ( t )  +  27(^1  +  n2  +  M)u{t) 


dt, 


Thus, 


(4.63) 


(4.64) 


(4.65) 


(4.66) 


(4.67) 


Ep(y|(t))  < 


27  —  rf 


[27(^1  +  n2  +  M) 


+  (fo- 


27  —  rf 


27(^1  +  k2  +  M) 


=-7(Ki+K2+M)(t-t0) 


-2 


(4.68) 


By  using  Holder’s  inequality,  inequality  (4.61)  follows  . 


□ 


Theorem  4.3  If  47(^1  +  n2)  >  (27  +  3  rf),  then 


Ev[\y2{t)\\  > 


1 


—  I  +  — 

«1  /  C*1 


(4.69) 
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where 


Pi  =  7  +  I7?2! 


3„2 
2'/  ) 

«i  =  2-/(m  +  k2)  -  Pi. 

Proof.  Using  the  fact  that  y2  >  0,  define  the  Lyapunov  function  v  :  [to,  00)  x 

v(t,y  2)  =  ~2- 
V2 

Then  from  (4.14)  and  (4.36),  using  the  fact  that  —  <  +  1,  we  have 

V2  y2 


(4.70) 


by 


(4.71) 


2  3 

d\  = - o[72/2(«i  +  «2  +  Vi  ~  2/2)]  +  -^a2(t,y2t  -  «i) 

L  s/2  vi  . 

<  [— aiv  +  Pi\dt  -  2\a(t,  y2t  -  n\ )dW2(t). 


dt - ~cr{t,y2t  -  ki )dW2(t), 

Vi 


Thus, 


d(veai<)  <  f3ieaitdt  —  2\cr(t,y2t  —  ni)dW2{t). 


Hence, 


Ep[v(t)]  <  fv0  -  — ) 

\  oil  J  at 

Applying  Jensen’s  inequality,  the  result  follows. 


□ 


4.5  Risk-Neutral  Dynamics 

In  this  section,  we  present  a  risk-neutral  dynamic  model  corresponding  to  (4.8). 

DEFINITION  4.5.1  A  probability  measure  V  is  said  to  be  risk-neutral  if 
•  V  and  V  are  equivalent  (  that  is,  for  every  A  €  T,  V(A)  =  0  if  and  only  if¥(A)  =  0),  and 


•  Under  V,  the  discounted  price  D(t )  is  a  martingale. 

We  shall  use  this  definition  to  find  a  risk-neutral  dynamics  for  our  model  (4.8). 
Define  the  riskless  asset 


Bi  (f )  =  exp 


n(s)ds 


L  J  to 

where  ry,  i  =  1,  2  are  the  interest  rate  function. 


t  e  [0,  T],  i  =  1,2 


(4.72) 
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Using  the  first  two  components  of  (4.14),  define  the  discounted  price  of  yi(t)  =  x\ (t)  —  k2, 
y2{t)  =x2(t)  +  K  i,by 


n  ^<(°) 

m)  =  M)  =  p 

Applying  Ito’s  Lemma  to  (4.73),  we  have 
(ID  i  =  -5Dl 


-  /  ri(s)ds 

Jt0 


yi(t). 


(4.73) 


rtKo+K2+yi)+n  dt  +  dWl^ 

dD2  =  a(t,  y2t  -  Kl )D2  dt  +  dW 

Define  the  market  price  of  risk 

Q ^  _  M(K0+K2+'i/l)+T,l 


(4.74) 


q ^  _  i{yi+^i+K-2—y2)-i'2 


(4.75) 

a(t,ip2-Ki)  5 

where  tpi,  i  =  1,  2  are  as  defined  in  (4.15). 

Using  Girsanov’s  theorem,  we  obtain  the  following  result  concerning  the  change  of  probability 
measure. 

Theorem  4.4  Suppose  that  Oi,  i  =  1,2  satisfy  the  Novikov’s  condition  [108],  with  the  V -Wiener 
process 

{  Wi  ( t )  =  W(  (t)  +  r!  ( u)du , 

(4.76) 


Wi(t)  =  W\(t)  +  f*o  6\{u)du, 
W2(f)  =  W2(t)  +  /t*  e2(u)du. 


Then  Dt(t)  is  a  positive  local  martingale  with  respect  to  V,  and  is  given  by 


D\{t)  =  -Dio  exp 

D2(t)  =  D2q  exp 


(4.77) 


-?JD2(s,  V2S  -  « l)ds  +  Jt0a(s,y2s  -  Kj)dW2(s)  . 

Substituting  (4.76)  into  (4.14),  we  notice  that  first  two  component  of  (4.14)  reduces  to  a  geometric 
stochastic  equation  given  by 


dyi  =  ri(t)yidt  -  5yidWi 

dy2  =  r2(t)y2dt  +  (j{t,y2s  -  n1)y2dW2 


(4.78) 


Using  transformation  (4.12),  (4.78)  reduces  to 


dx  i  =  —  r\{i\2  —  x\)dt  +  5(k2  —  x\)dW\ 
dx2  =  r2(x2  +  ni)dt  +  a(t,x2t)(x2  +  ni)dW2 


(4.79) 
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Chapter  5 

Parameter  Estimation 


5.1  Introduction 

In  this  chapter,  we  present  the  estimation  scheme  to  estimate  the  parameters  in  the  interconnected 
system  of  nonlinear  stochastic  differential  equation  (4.11).  We  use  discretized  Scheme  for  Continuous- 
Time  GARCH  Model  to  develop  the  Maximum  Likelihood  techniques,  the  developed  techniques  is 
used  to  estimate  parameters  in  the  model  for  volatility  process  in  (4.11).  Furthermore,  modifying 
the  extended  Kalman  filter  technique,  we  estimate  the  parameters  in  the  model  for  log-spot  and 
expected  log-spot  price  in  (4.11). 

The  Kalman  Filter  is  a  powerful  and  widely  used  technique  in  state  and  parameter  estimation 
problems.  It  is  used  for  finding  minimum  mean  squared  error  (MMSE)  estimation  of  linear  state 
dynamic  systems  and  observations  [115].  Nonlinear  state  dynamic  and  observations  arc  estimated 
by  employing  the  Extended  Kalman  Filter  (EKF)  scheme  [115].  Moreover,  the  EKF  scheme  deals 
with  state  and  parameter  estimation  of  linearized  version  of  both  nonlinear  state  dynamic  and  ob¬ 
servations  [73].  It  is  well  known  [78]  that  the  linearized  Taylor  scheme  does  not  provide  sufficiently 
accurate  representation.  Moreover,  due  to  its  overly  crude  approximation,  the  scheme  generates 
problem  in  convergence  [78]. 

Several  other  approaches  have  been  made  to  find  a  better  filter  than  the  EKF  scheme.  Unlike 
the  usual  EKF  approach,  Magnus  [78],  Tor  Steinar  [124]  and  Luo  [75]  propose  a  new  set  of  esti¬ 
mators  which  arc  based  on  polynomial  approximations  of  the  nonlinear  transformations  using  the 
Stirling’s  interpolation  formula.  Under  this  scheme,  derivatives  of  rate  functions  arc  avoided  due 
to  interpolation  approximation  formula.  As  discussed  in  [78],  the  Stirling’s  interpolation  formula 
accommodates  easy  implementation  of  the  filters  and  enables  state  estimation  when  the  derivatives 
are  not  smooth.  It  has  been  remarked  that  this  approach  provides  a  similar,  or  superior  performance 
than  the  existing  EKF  approach.  Simon  Julier  [113,  1 14,  1 15]  claims  that  the  EKF  filtering  strategy 
is  difficult  to  implement,  difficult  to  tune,  and  only  reliable  for  systems  which  arc  almost  linear.  This 
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leads  to  the  development  of  a  new  linear  state  and  covariance  estimator  using  unscented  transfor¬ 
mation.  The  new  scheme  was  claimed  to  be  superior  than  that  of  the  EKF,  and,  in  fact,  the  scheme 
generalizes  elegantly  to  the  nonlinear  system  without  the  linear  step  required  by  the  EKF  scheme. 
Higher  filters  have  also  been  discussed  by  Jazwinski,  [53],  Maybeck,  [81],  and  Madsen  etal  [76]. 

Our  main  focus  in  this  paper  is  to  reduce  the  magnitude  of  error  that  occurs  during  the  estimation 
process  of  the  EKF  approach.  This  error  is  due  to  the  overly  simplified  approximation  scheme. 
In  the  process  of  the  error  reduction,  we  modified  the  Extended  Kalman  Filter  scheme  by  incor¬ 
porating  second  order  polynomial  approximation  for  the  expected  state  variable  and  covariance. 
This  scheme  is  applied  to  study  the  state  and  parameter  estimation  problems  of  nonlinear  system  of 
stochastic  differential  equation.  The  drift  and  diffusion  paid  of  the  nonlinear  differential  equations 
arc  approximated  using  the  Stirling’s  interpolation  formula  [78].  This  modified  approach  estimates 
the  parameters  of  a  system  of  nonlinear  stochastic  differential  equation  with  lesser  magnitude  of 
error  compared  to  the  usual  EKF  approach  [73].  Although  the  magnitude  of  error  in  the  state  and 
covariance  of  the  EKF  is  reduced,  it  is  however  important  to  note  that  our  scheme  is  computationally 
too  demanding/computer  intensive.  An  algorithm  is  developed  to  implement  this  scheme.  The  ex¬ 
tended  Kalman  filter  approach  is  compared  with  the  developed  modified  extended  Kalman  filtering 
approach.  The  scheme  is  applied  to  Henry  Hub  natural  gas  data  and  to  estimate  parameters.  The 
details  arc  exhibited  in  the  graph. 

The  organization  of  this  work  is  as  follows: 

In  Section  5.2,  we  present  the  discretized  scheme  for  continuous-time  GARCH  Model.  In  Section 
5.3,  we  present  a  modified  EKF  scheme.  In  Section  5.4,  we  applied  the  scheme  to  estimate  the 
parameters  for  a  stochastic  dynamic  model  for  Henry  Hub  Natural  gas. 

5.2  Discretized  Scheme  for  Continuous-Time  GARCH  Model  (4.10) 

In  this  section,  we  formulate  a  discretized  scheme  and  outline  a  procedure  for  estimating  the  param¬ 
eters  cr,  j3,  t  and  c  in  (4.10).  An  outline  of  the  procedure  is  given  below: 

Define  the  discrete-time  delay  value  l  to  be  the  analogue  of  the  continuous-time  delay  r.  Given 
the  value  of  l,  we  define  the  size  of  the  mesh  of  the  discrete-time  grid  as  A  =  j.  Furthermore,  we 
define 

G  =  oiG,  (5.1) 

where  £*  is  a  white  noise  process.  The  discrete-time  delayed  model  corresponding  to  (4.10)  for 
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volatility  is  described  by 


cr2  =  cr  +  f3At 


i  2 


E 

.2=1 


&n.—i 


+  9°n-l- 


(5.2) 


of  =  of  for  i  6  [— r,  o],  and  g  =  1  +  c. 


Since  is  a  normal  random  variable  with  mean  0  and  variance  of,  we  can  write 


E 

2=1 


£n—i  — 


E' 


(5.3) 


where  e  is  a  standard  normal  variable.  Hence,  (6.1)  reduces  to 


+  /3At^a,2-ie2  +  gcr2_t, 


(5.4) 


2=1 


Using  the  fact  that  e2  is  a  y2(  I )  random  variable,  we  find  the  probability  density  function 
/KkL,  1  <  i  <  l)  of  of  given  cr2.*,  1  <  *  <  l  to  be 


f,  2,  2  ,  /  ■/  n  5 

/Kkn-ii  !<*<«)  =  - 7  =^~  exp 

J  2irf3At  E  o-n_i 


o-2  -  a  -  gcr2_i 


E 

2=1 


,  a+gcr2_i  <  of  <  oo. 


(5.5) 


We  define  the  Likelihood  function  of  of  as 

N 

£(H3)  =  log  J]  /(rT2jH3,f72_i,  1  <  *  <  0 

72=1 

where  H3  =  {cr,  /3,  g}  arc  the  parameters  to  be  estimated.  Thus, 

1  N 

£®>)  =  -5Eln 

72=1 


(5.6) 


2  ^  „  2 

N 

2  ^  2 

<-Oi-  q(Tn-i 

-E 

<-&-  Wn- 1 

i 

i 

2n/3At  E  °-2n-i 
2=1 

72=1 

/3Af  E  T2_* 

i=l 

(5.7) 


Our  aim  is  to  find  estimators  that  maximize  the  Likelihood  function  (5.7)  subject  to  the  constraint 
(2.49). 

Hence,  solving  for  the  maximum-likelihood  estimators  cr,  l3  and  q  of  cr,  f3  and  q  respectively,  we 
have 


P 


N 


N 

E 

72=1 


(J2n- a-  qcr'n_ , 


At  E  <*_, 

2=1 
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and  a,  q  satisfies 


respectively. 

To  evaluate  the  parameters,  we  generate  the  observation  data  for  a(t,  1/9)  from  the  discrete  version 
of  (4.14)  described  as 

A?  In 

— -  =  7(«1  +  «2  +  Vi  ~  y2)A t  +  cr(t,  y2t)AW2.  (5.8) 

2/2 

We  achieve  this  by  using  y->  as  our  observation  data.  We  search  iteratively  to  find  the  parameters 
that  maximize  (5.7)  using  a  combination  of  direct  search  method  and  the  Nelder-Mead  simplex 
optimization  algorithm  in  Matlab.  This  completes  the  parameter  estimation  problem  of  (4.10).  The 
parameter  estimated  are  recorded  in  Table  3. 

Table  3:  Estimated  Parameters  of  rr2(t.  O2)  for  l  =  2  using  the  Henry  Hub  daily  natural  gas  spot 
prices  for  the  period  01/04/2000-09/30/2004  [24], 

a  (3  c  t 

0.07  1.149  -1.4814  0.005 


5.3  Modified  Extended  Kalman  Filter  Approach 

In  this  section,  we  shall  be  estimating  the  remaining  parameters  //,  7,  kq,  K] ,  Ka  and  <5  of  (4.8)  using 
the  Modified  Extended  modified  Kalman  Filter  Approach.  This  is  accomplished  by  approximat¬ 
ing  the  state  estimator  using  a  quadratic  approximation.  The  Kalman  Filter  Approach  is  modified 
by  employing  a  second  order  approximation  for  state  and  state  variance  predictions.  To  estimate 
the  parameters,  we  minimized  the  likelihood  function  of  the  prediction  error  of  the  measurement 
process.  The  approach  is  described  below. 
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We  assume  that  a  dynamic  state  x  <E  Mn  and  its  observation  data  y  €  Mn  are  described  by  a 


general  non-linear  stochastic  dynamic  systems. 


dx  =  f(x;  0)dt  +  g(x;  0)d\V(t),  x(to)  =  xo 
y(t )  =  h(®;0)  +  v(t), 


where  xq  is  a  stochastic  initial  condition  satisfying  4|xq  2  <  oo,  f  :  Mn  xKp->  Mn,  g  :  Mn  xKpG 
M.nxd,  h  :  Mn  x  — >•  Mn  are  continuous  functions,  W  :  M  — >  is  a  d—  dimensional  standard 
Wiener  process  on  a  filtered  probability  space  (fl,  F,  (F)t>o,V),  the  filtration  function  (F)t:>o  is 
right-continuous,  and  each  Ft  with  t  >  0  contains  all  P-null  sets  in  F,  x  is  Ft  adapted  process  and 
non-anticipative,  and  v  :  M  — >  Mn  is  a  n—  dimensional  zero  mean  Gaussian  white  noise  process 
independent  of  W,  8  e  0,  the  parameter  space. 

Prior  to  presenting  a  procedure  for  the  estimation  of  parameters,  we  define  the  following  termi¬ 
nologies  and  notations  used  throughout  this  work. 

Define 


\yti  i  Vt2  j  "*5  ytk 

as  all  observations  of  the  data  given  up  to  time  4- 


(5.10) 


x(t\tk_i) 

P(t\tk~i) 

R(t\tk~i) 

?’o,2(f|4-i) 

r2,2(t\tk-i) 

ri,2(t\tk-i) 

r0,3(f|4-i) 

n,3(f|4_i) 


E  [(x(t)  -  x(t\tk-i))(x(t)  -  x(f|4~t))T|Effc_1]  , 

E  [n(f)'UT(f)|Y4_1]  , 

E  [(y(0  -  y(*l4-i))(z/(0  -  y(*|4-i))T|itfc_i] , 

E  [(x(f)  -  x(f|4_t))(r/(f)  -  y(t.\tk-i))T\Ytk_1]  , 

E  (x(t)  -  x(t\tk-i))  (x(t)  -  x(f|4_i))T  (y(t)  -  y(t|4_i))x 
(y(t)  -  y(f|4-t))Tl>fc-il , 


x(t)(y(t)  -  y(f|4-i))T(Y(f)  -  Y(f|4_i))T|Ytfe_ 

(y(t)  ~  y(t\tk-i))(y(t)  -  y(t|4_i))T(Y(t)  -  Y(f|4_i))T|Ytfe_1 
E  [(x(t)  -  x(f|4_i))(r/(f)  -  y(f|4-i))T(f/(i)  -  y(f|4-t))x 
(y(f)  -y(f|4-i))r|Ytfc_1] 


(5.11) 
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ro,4(t|4-i)  =  IE  [(y(t)  -  y(t\tk_i))(y(t)  -  y{t\tk_i))T  (y{t)  -  y(t\tk_i))x 

(y(t)  ~  y(t|4-i))Tl>tfc-1]  > 

M0,2(f|4-i)  =  E  (Y(t)  -  Y(t\tk-i))(y(t)  -  y(t\tk-i))(y(t)  -  y(t\tk-i))Tx  (5.12) 

VY2(t\tk-i)  =  E  (Y(i)  -  Y(t|4_i))(y(t) -y(t|4_i))|y*fc_1  , 

where 

y(t)  —  y(t|tfe_i)  0  ...  0 

0  y(t)  -y(t|4-i)  •••  0 

:  O'--: 

0  ...  0  y(t)  -  y(t\tk-i) 

Let  x(tk\tk_i)  be  the  a-priori  state  estimate  at  step  k  given  the  knowledge  of  process  Ytk  l,  and 
x(tk\tk)  be  the  posterior  state  estimate  at  step  k  given  the  knowledge  of  process  Ytk.  The  Extended 
Kalman  Filter  approach  begins  with  the  goal  of  computing  a-posterior  state  estimate  x(tk\tk)  as  a 
linearized  approximation  of  the  form 


{x(tk\tk)  =  A0  +  Axiy^k)  -  y(tk\tk-i)), 
P{tk\tk )  =  Bo¬ 
lt  was  shown  in  Jazwinski  [53]  that 


(5.14) 


Ao{tk\tk—l)  X  (tk  |  i ) , 

Ai{tk\tk-i)  =  ri:i(tk\tk-i)rQtl(tk\tk-i),  (5-15) 

B0(tk\tk-i)  =  P(tk\tk-i)  —Ai(tk\tk-i)rot2(tk\tk-i)Ai(tk\tk-i), 

where  A\  is  the  Kalman  gain.  Instead  of  approximating  the  conditional  covariance  at  an  observation 
as  a  constant,  Jazwinski  [53]  extended  it  to  an  approximation  of  order  one. 

For  the  rest  of  this  study,  for  the  sake  of  simplicity,  we  write  f(x)  =  f(x;  6),  g(x)  =  g(x;  6), 
and  h(x)  =  h(.r;  6).  In  this  study,  we  extend  the  approximate  equations  for  the  conditional  mean 
and  covariance  at  an  observation  to  that  of  order  two.  To  do  this,  we  first  state  the  Taylors  series 
expansion  of  a  vector  value  function  f  about  the  vector  y, 

Mv)  1  (92f(y) 

f(y)  =  f(y)  +  -g^-( y  -  y)  +  -^f4diag(y  -  y,y  -  y,  ...,y  -  y)(y  -  y),  (5.16) 
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02fn  ; 

'  '  Oydyn  / 

diag(y  —  y, y  —  y)  =  Y(t)  -Y(t\tk_i). 


We  note  that  and  Y(t)  —  Y (f  are  n  x  n  block  matrices  whose  entries  arc  n-dimensional 

92ffv) 

row  vectors  and  column  vectors,  respectively.  Moreover,  f)y2  is  referred  to  as  vector-valued  Hes¬ 
sian  matrix,  and  Y (t)  —  Y(t\tk_  i )  is  a  diagonal  matrix  defined  in  (5.13). 

Following  these  definitions  and  notations,  we  define  the  a-posterior  state  estimate  x(tk\tk)  and 
a-posterior  covariance  estimate  P{tk\tk)  as  a  quadratic  approximation  of  the  form 


x(tk\tk)  =  A)  +  Ai(y{tk )  -  y(tk\tk_i))  +  A2(Y(t)  -  Y(t|4_i ))(y(tk)  -  y(4|4-i)) 
P(tk\tk )  =  B0  +  Bi(y(tk)  -  y(tk\tk_i))(y(tk)  -  y(tk\tk-1))T, 

(5.17) 

where  Aq  is  an  n  x  1  matrix  (column  vector),  .4]  is  an  n  x  n  matrix,  A2  is  an  n  x  n  block  matrix 
whose  entries  arc  1  x  n  matrix  (row  vector),  B o  and  B\  are  square  n  x  n  matrices. 

In  order  to  develop  an  algorithm  for  x(tk\tk)  and  P(tk\tk),  we  need  to  solve  for  the  A,-  and  Bt 
for  i  =  0, 1,  A2.  For  this  purpose,  we  need  to  evaluate  each  quantity  in  (5. 1 1)-(5. 12).  We  use  the 
multi-dimensional  extension  of  Stirling’s  interpolation  formula  discussed  in  Magnus  [78]  and  Luo 
[75]  to  approximate  the  state  drift,  diffusion  and  the  observation  functions  in  (5.9)  up  to  the  second 
order. 

Using  the  second-order  polynomials,  we  define  the  multidimensional  interpolation  formula  as 


f(x)  =  f(x)  +  DAxf(x)  + 
g(x)  =  g(x)  +  DAxg{x)  +  \D\xg(x), 
h(x)  =  h(x)  +  UazMx)  +  \D\X  h(x), 
where  the  operator  Dax,  and  D\x  are  described  in  [78]  and  are  defined  by 


D  Ax  — 


h  ^  £  ^Xp^pfip J  5 

n  n  n 

TP  E  Axlsp  +  E  E  AxpA xq(npSp)(yqSq)  |  , 

P=1  p=lq=l 

\  <?YP 


(5.18) 


(5.19) 


49 


where  Ax,  Sp  and  /ip  are  defined  by 


=  x  —  x. 


5pf(x)  =  f  (x  +  |ep)  -f(x-  |ep)  , 
iipi(x)  =  \  [f  (x+  |ep)  +f  (£-  |ep)]  , 


(5.20) 


and  h  >  0  is  the  step  size,  ep  is  the  pth  unit  vector. 

Using  the  Cholesky  transformation,  we  transform  x  to  a  variable  2;  which  is  mutually  uncorre¬ 
lated.  Following  [78],  we  write 


z  =  Sx  1x, 

f  (z)  =  f(Sxz)=f(x). 


(5.21) 


From  (5.21),  (5.18)  reduces  to 


f '(*)  =  i(z)  +  DAei(z)  +  ±Dljt(z), 

g(z)  =  g  (z)  +  DAzg(z)  +  \D\zg(z), 

6(2)  =  h(z)  +  DazHz)  +  ±D2Azh{z). 


(5.22) 


Let  di  represent  the  ith  moment  of  an  arbitrary  element  in  Az.  We  shall  use  the  interpolation 
approximations  (5.22)  to  evaluate  the  expressions  in  (5. 1 1)-(5. 12).  For  this  purpose,  we  prove  the 
following  Lemma. 


Assumption  B  : 

As  discussed  in  Magnus  [78],  we  assume  A2  to  be  iid  Gaussian.  Hence, 


<j2i- 1  =  0,  ieR. 


(5.23) 


LEMMA  5.1  Under  the  Assumption  B,  we  have 


ro,2{tk\tk-i)  =  p  +  aAAh42  SZ 

p=  1  p= 1 

2  n 

+  AhA  E  fJ'pSpfJ'qSqhflpdpflqdqh  +  R 


^*1,1  (tk  \tk—  l)  —  ^  ^  yfJ/pSph^A 

P=  1 


n,2{tk\tk-i)  =  Sx^D{tk\tk-i ){,;! /-T})1<  .<  +x(tk\tk-i)ro,2(tk\tk-i){jlijtT} 
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n,3(4|4-i)  =  SXJ  -  2SxE(tk\tk-i)  -  2ri)1C(tk\tk-i)CT  -  ri^CTC(tk\tk-i) 

—SxD(tk\tk—i){~T~yC  , 

T'2,2(j'k \^k—  l)  =  Sx  (Qi,j )  l<i<n 

l<ji<n 

^0,3  \tk—  l)  =  {L/i,j)l<i<n 

l<j<n 

ro,4(4|4-i)  =  E  [A4TA4T|ytfc_1]  -  E  [AATACT\Ytk_1]  -  E  [AATCAT\Ytk_1\ 

+E  [AATCCT\Ytk_1]  -  E  [ACTAAT\Ytk_1]  +E[ACTACT\Ytk_1] 

+E  [ACTCAT]  -  E  [ACTCCT\Ytk_1\ 
o-y2(4|4-i)  =  (Fj)  i<j<n, 

where 

A  =  D\zh{z)  +  Jt(4)  +  v 

n 

c  = 

P=1 

n  2  n 

Fi  =  p  E  (^(^))  E 

p=  1  p=  1 

2  n  n 

^4  ^  ^  ^  ^  ^lApSpflqdqh  (-S)^  llpdpllqSqlli^z)  +  C{Rii 

P=  1  9=1 
9/P 

(n  2  n 

Y1  VPtiphi(z)nPdphT(z)  +  rT;[//'’2  ^  Sphi(z)6pitT (z) 

p= 1  p=1 

2  n 

4  ^^4  ^  "  UpSp/lqSqhiUpSpIlqdqh  T"  Rip& 

p,q= 1 

qf=p 

h  =  /i(z)  =  A(z(4|4-i))»  ^0,2 (4 1 4- 1)  =  ^o,2(4|4-i)  ^Ty  and  detailed  expressions  for 
ro,2(4|4-i){^^},  J(4|4_i),  4(4|4-i),  E>(4|4-i){^t})  4>(4|4_i){-t  ^,  -D(4|4-i)^. 
Qij,  E  [A4TA4T|ytfc_1],  E  [A4T^C,T|ytfc_1]>  E  [AA^A'HlVj,  E  [A4TC'C7T|ytfc_1]>! 

E  [AC^AA^.J,  E  [AC^AC^.J,  E  [AC^C'AT|ytfc_1],  E  [AC^CC^lVj,  and  LtJ 
are  given  in  Appendix  B.  2. 

Proof.  The  proof  is  given  in  Appendix  4.3.  □ 

We  can  now  use  these  values  to  solve  for  Aj,  Bi,  z  =  0,1,  and  A  9.  The  first  step  in  the  algorithm 
is  to  solve  for  Aj,  Bt,  i  =  0, 1  and  A2  in  (5.17).  For  this  purpose,  we  use  the  following  Lemma  by 
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following  the  description  of  the  moment  propagation  procedure  across  the  observations  described 
in  Jazwinski  [53]. 

LEMMA  5.2  Under  the  assumptions  in  Lemma  5.1,  we  have 

A)(4|4-i)  =  ri,o(tk\tk-i)  -  A2(tk\tk-i)crY2(tk\tk-i)1 

Ai(tk\tk-i)  =  [ri,i(ffc|ffc-i)  -  A2{tk\tk-i)ro^(tk\tk-i)T}  r0,2(4|4-i)_1,  (5-24) 

A2(tk\tk~i)  =  Ti(4-|ffc_i)T2”1(4|ifc_i), 

where 

Ti(tk\tk-i)  =  —  rifl(tk\tk-i)<7Y2{tk\tk-i) 

— ri,i(tk\tk-i)r0l(tk\tk-i)ro,3{tk\tk-i) 

T2(tk\tk-l)  =  M0t2(tk\tk-l)  —  &Y2(tk\tk-l)&Y2(tk\tk-l) 

-ro,3(tk\tk-i)ro:l(tk\tk-i)r0:3(tk\tk-i)- 

Proof.  Proof  is  in  Appendix  BA.  □ 

Remark  7  If  A2  =  0,  (5.2)  reduces  to 

Ao  =  x(tk\tk-i) 

Ai  =  ri,i(4|4_i)r0,2(4|4-i)_1- 

Now,  we  present  a  Lemma  for  finding  /if,  and  B\ . 

LEMMA  5.3  Under  the  assumptions  in  Lemma  5.1,  we  have 

B\  =  ^(V2(4|4-i)?42(4|4-i)  -  M(4|4-i))  r0,4(4|4-i)^2(4|4-i) 

—^o,2  (*fe  |ifc— i)]  ~ 1  (5-25) 

Bo  =  Ni(tk\tk-i)  —  Bi(tk\tk-i)ro^(tk\tk-i), 
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iVi  =  E  [(x(4)  -  x(4|4))(x(4)  -  x{tk\tk))T\Ytk_1\ 

=  P(4|4-i)  -  r-i,i(4|4_i)^f  -  7-1,2(414-1)^2  -  241r1,1(4|4_1)T 
-y42ri,2(4|4-i))T  +  (x(4|4-i)  -  A))(£(4|4-i)  -  A))r 
— (f(4|4-i)  -  ^o)r-o,2(4|4-i){^.  jT  i 2 
+-4in),2(4|4-iMi  +  ^4iro,2(4|4-i)^.  ^^2 
— A2ro,2(tk\tk-i)  ~  (x(4|4_i)  —  A0) 

+^2^o,3(4|4-i)^4i  +  A2M0^ 2(414-1)^2' 
iV2  =  E  [(x(4)  -  x(4|4))(x(4)  -  x(4|4))T(y(4)  -  y(4|4))x 
(2/(4)  -  y(4|4))T|^fc_1] 

=  E  ( [(z(4)  -  A))(®(4)  -  ao)t  -  (x(tk)  ~  A))(y(4 )  -  y(4|4-i))T^T 
-(x(4)  -  A0)(y(tk)  -  y(4|4-i))T(Y(4)  -  Y(4|4_i))tA2 
-Ai(y(tk)  -  y(4|4-i))(z(4)  -  A))T 
+Ai(y(4)  -  y(4|4-i))(y(4)  -  y(4|4-i))T^ri  x 
(y(4)  -  y(4|4-i))(y(4)  -  y(4|4-i))T|*V1) 

=  r2,2  +  (x(4|4_i)  -  240)(x(4|4-i)  -  A0)Tr0,2 

-  IE  [(x(4)  -  x(4|4_i))(y(4)  —  y(tk\tk-i))T Aj (y(tk)  -y(4|4-i))x 
(y(4)  -  y(4l4-i))T|ifc-i] 

-  IE  [(x(4|4_i)  -  A0)(y(tk)  -  y(tk\tk-i))TAj(y(tk)  -y(4|4_i))x 
(y(4)  -  y(4|4-i))T|ltfc_1] 

-  E  [Ai(y(tk)  -  y(4|4-i))(x(4)  -  ®(4|4-i))T(y(4)  -  y(4|4-i))x 
(y(4)  -  y(4|4-i))T|itfc_1] 

-  E  [^i(y(4)  -  y(4|4_i))(x(4|4_i)  -  A0)T(y(tk )  -  y(4|4-i))x 
(2/(4)  -y(4|4-i))T|itfc_1] 

+  IE  [4i(y(4)  -y(4l4-i))(y(4)  -  y(4l4-i))T^T(y(4)  -y(4|4-i))x 
(y(4)  -  y(4|4-i))T|*Vi]  ,  and  x(4|4)  is  given  in  (5.17). 


Proof.  The  proof  is  shown  in  Appendix  B.5. 


Remark  8  If  B\  =  0,and  A2  =  0,  then  from  (5.25)  and  Remark  7,  we  have 

-A-0  ^*1,0  (j'k \^k— l)  %(j'k\t'k— 1)5 

Ai  =  ri!i(4|4_i)r0i2(4|4-i)_1 

Bo  =  Ni  =  Ptfc|tfc_1  -  Air0,2(tk\tk-i)Ai . 

Thus,  the  presented  state  and  covariance  algorithm  includes  the  EKF  scheme  [82]  as  a  special  case. 


5.3.1  Posterior  Prediction  of  State  and  Covariance  of  Nonlinear  System 

A  final  step  in  the  recursive  algorithm  is  to  predict  the  state  x{tj+\  \t,j)  and  state  variance  P(tj+\  \t:j) 
at  the  time  of  the  following  measurement.  Using  (5.9),  the  definition  of  P(t|4-i)  in  (5.11),  and 
(5. 18), we  have 


x(4+i|4)  =  x(tk\tk)  + 


f(z(4|4))  +  ^f(z(tk\tk)) 


p= i 


At, 


-P(4+i|4)  =  P(tk\tk)  +  52  np6pf(z(tk\tk))e^ ^  J2  Sxepfj,pSpf  (z(tk\tk)) 

p= 1  p= 1 

7X  ^  ™ 

+W  E  fi'p8pt(z(tk\tk))fj,p5pf  (z(tk\tk)) 

p=  i 

2  IT  ^  „rp 

+  ^  E  ^f(2(4|4))^f  (i(4|4)) 

P=1 

n 

+,0g(^(4|4))  E  <SpiT(2(4l4)) 

p=i 

2  Tl  -  _  ~r[' 

T  4 h?  E  IXpfiplXq5qt(z(tk\tk'))  flp5pfj,q5qf  (2(4|4)) 

P.?=l  L 

ppg 

~  ~T 

-\-^Lp5pfXq5qf(^z(tk\tk))  flqdqfipdpf  (2(4 1 4)) 

n 

+  pE  Aip5pg(2(4|4))^p5pgT(^(4|4))  +  g(2(4|4))gT(z(*fc|4))--- 

p=i 

n 

+  #  E  <5pg(z(4|4))gT(^(4|4)) 

p=i 


+i^  E  <*pg(«(4|4))£pg  (5(414)) 


p=i 


(5.26) 


+  4  y  L52 

'  17?  -A  \up 

p,q= 1 

ppq 


52  \Spg{z(tk\tk))Sqg  (2(4|4)) 
-\-fJ>p5ptlqSqg(z(tk\tk))[J,p5p[iq8qg  (2(4 14)) 


At 


T  4^2  E  Mp<5pA*g<^g(2(4|^fc))MqAA*p<^pg  (2(4|4))  ]At 

p,q=l  L  J 

Pt4 

The  one  step  prediction  error 


Ay(A;)  =  yk  -  y(4|4-i 


(5.27) 
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is  assumed  to  be  normal  with  mean  0  and  variance  ro,2-  Hence,  for  N  independent  random  obser¬ 
vations,  the  Maximum  Likelihood  approach  is  equivalent  to  maximizing 


N 


£(®>  =  -5£ 


k= 1  L 

where  ©  is  the  parameter  space. 


^AyT (k)r0l(tk\tk-l)Ay(k)  +  log  |r0)2(4|4-i)| 


(5.28) 


Remark  9  The  presented  predicted  algorithm  extends  the  algorithm  generated  by  the  EKF  ap¬ 
proach  in  a  systematic  way.  We  further  remark  that  the  second  order  estimation  for  nonlinear 
stochastic  systems  can  be  extended  to  higher  order  estimation.  The  scheme  is  highly  complex  math¬ 
ematical  expressions.  Further  detailed  examination  (applicability/computational,  feasibility,  et.c)  is 
under  investigation. 


5.3.2  Algorithm 

We  describe  the  algorithm  used  in  the  computation  of  the  estimates  for  nonlinear  log-spot  price 
stochastic  differential  equation  (5.29)  in  Appendix  B.  1. 


5.4  Some  Results:  Natural  Gas 

In  this  section,  we  give  the  paiamctcr  estimates  for  the  stochastic  differential  equation  (5.9).  We 
consider  the  nonlinear  stochastic  differential  equation  that  was  developed  for  describing  continuous 
time  stochastic  dynamic  model  of  energy  commodities  log-spot  price  processes  in  (4.11), 


dx  1  =  fi(x\  +  k0)(k2  -  X\)dt  +  5(k2  —  xi)dWi(t),  xi(t.0)  =  xw, 

dx 2  =  7(x2  +  Ki)(xi  -  X2)dt  +  (j(t,  X2t)(x2  +  Ki)dW2(t),  x2(to)  =  £02-  (5-29) 

y(t)  =  x(t)  +  v(t). 


It  follows  from  (5.29)  that 


/ <5(k2  -xi)  0  \ 

\  0  v(t,X2t)(x2  +  Kl)J 

and  x  =  {x\,X2}T ,  where  /r  >  0,  7  >  0,  kq  >  0,  >  0,  K2  >  0,  5  >  0,  cr  >  0,  v  is  a  white 

noise,  and  W  =  {W\,  IIT}7^,  W\  and  W2  arc  independent  Wiener  processes.  This  model  governs 
the  price  for  energy  commodity  at  time  t.  x2  (t)  is  the  nonseasonal  log  of  spot  price  at  a  time  t  and 


f  (x;0)  = 


H{x  1  +  k0)(k2  -  xi) 
7(x2  +  Ki)(^t  -  x2)t 


,g  (x-,0)  = 
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x\ (t)  describes  a  mean  process  of  non-seasonal  log  spot  price  at  time  t.  The  model  (5.29)  follows 
the  principle  of  demand  and  supply  processes  which  suggest  that  the  price  of  a  energy  commodity 
will  remain  within  a  given  finite  lower  and  upper  bounds  k\  >  0  and  Ka  >  0,  respectively.  In  this 
case,  K2  characterizes  the  fixed  cost,  (x\  (t)  +  kq )  ( —  x\)  characterizes  the  market  potential  for 
x\(t)  per  unit  of  time  at  a  time  t.  We  note  that  the  first  component  of  (5.29)  has  a  unique  non-zero 
equilibrium  K2 .  Moreover,  we  observe  that  whenever  the  price  x\  lies  above  re  2 .  there  is  a  tendency 
for  the  price  to  fall  and  whenever  the  price  is  below  K9 .  the  price  rises  back.  Hence,  n-2  is  the 
equilibrium  of  the  first  component  of  (5.29).  Furthermore,  /t  and  7  are  the  rate  of  mean  reversion 
for  x\  and  x'2  respectively,  6  and  a  are  the  volatility  for  x\  and  x'2  respectively. 

We  apply  this  model  to  the  Henry-Hub  natural  gas  data  set  [24] .  We  use  the  Henry-Hub  natural 
gas  spot  price  data  set  [24]  for  the  observation  data  for  X2.  We  generate  observation  data  for  x\ 
from  the  forward  price  F(t,  T)  at  time  t  of  an  energy  goods  with  maturity  at  time  T.  We  define  the 
forward  price  as 

F(t,T)  =  Er(x2(T)).  (5.30) 

By  definition,  xi(f)  is  the  expected  log-spot  price,  which  in  this  case  is  the  observation  data  F(t,  T ). 
We  use  Henry-Hub  natural  gas  observed  future  price  at  a  time  t  with  delivery  time  T. 

The  existence  and  uniqueness  of  the  solution  of  (5.29)  is  given  in  Chapter  4. 

/ 0.1182  0 

The  initial  state  ofthe  model  is  xi(fi|fo)  =  1.23,  X2(ti|fo)  =  1.456,  P(ti\to)  = 

\  0  0.22 

Table  (4)  shows  the  parameter  estimates  of  Henry  Hub  daily  natural  gas. 

Table  4:  Estimated  Parameters  of  (5.29)  for  Henry  Hub  daily  natural  gas  spot  prices  (20  run  average) 


F 

7 

Kl 

K-2 

5  a 

1.6 

1.78 

.69 

.56 

1.5 

0.65  0.47 

Table  4  shows  the  estimates  of  the  parameters  of  (5.29). 

Furthermore,  we  show  some  of  the  estimates  of  the  simulations  for  the  modified  extended  Kalman 
filter  (MEKF)  scheme  compared  with  the  usual  EKF  scheme. 
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Table  5  shows  the  real  data  sets,  estimated  simulation  results  for  the  Modified  EKF  scheme  and  the  usual  EKF  scheme. 
The  estimated  error  is  calculated  by  subtracting  the  simulated  estimates  from  the  real  data  set. 

We  show  the  graph  of  the  real  and  simulation  results  using  MEKF  scheme. 

Real  Price  for  Natural  gas  Simulated  Price  for  Natural  gas 


Real,  Simulated  and  Difference  plot 


Figure  5.:  Real  and  Simulated  price  for  Natural  gas  data  set  [24]  using  Modified  EKF  scheme 
Furthermore,  we  show  the  graph  of  the  real  and  simulation  results  using  EKF  scheme. 

Real  Price  for  Natural  gas  Simulated  Price  for  Natural  gas 
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Real,  Simulated  and  Difference  plot 


time  t  (days) 

Figure  6. :  Real  and  Simulated  price  for  Natural  gas  data  set  [24]  using  EKF  scheme 

Figure  5  (a)  shows  the  graph  of  the  real  natural  gas  data  set,  Figure  5  (b)  shows  the  simulated  price  using  Modified 
EKF  scheme,  and  Figure  5  (c)  shows  the  combination  of  the  real,  simulated  and  difference  of  the  real  and  simulated  price 
of  the  natural  gas  data  set  using  the  modified  extended  Kalman  filter  second  order  estimation  scheme. 

Figure  6(a)  shows  the  graph  of  the  real  natural  gas  data  set.  Figure  6  (b)  shows  the  simulated  price  the  usual  ordinary 
EKF  scheme,  and  Figure  6  (c)  shows  the  combination  of  the  real,  simulated  and  difference  of  the  real  and  simulated  price 
of  the  natural  gas  data  set  [24]  using  the  usual  ordinary  EKF  scheme. 

The  following  graph  show  the  absolute  error  of  the  simulation  result  using  the  MEKF  and  EKF 
scheme. 

Absolute  error  for  Modified  EKF  Absolute  error  for  EKF 
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Absolute  error  comparison 
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Figure  7.:  Absolute  error  estimate  using  natural  gas  data  set  [24] 


Figure  7  (a)  shows  the  absolute  error  of  the  simulations  of  natural  gas  data  set  using  the  modified  extended  Kalman 
filter  scheme,  Figure  7  (b)  shows  the  absolute  error  of  the  simulations  of  natural  gas  data  set  using  the  usual  extended 
Kalman  filter  scheme,  and  Figure  7  (c)  shows  the  comparison  of  the  absolute  error  for  the  modified  and  usual  EKF 
scheme. 

Remark  10  We  further  remark  that  all  codes  are  written  in  Matlab.  To  compute  the  maximization 
argminL(@)  in  the  algorithm,  we  use  the  Nelder-Mead  Simplex  Method  developed  in  Matlab. 
Maximizing  (5.28)  is  equivalent  to  minimizing 


(5.31) 


Remark  11  It  is  clear  from  Figures  5  and  6  that  the  presented  scheme  is  superior  than  the  EKF 
approach.  This  shows  that  the  modified  extended  Kalman  filter  does  in  fact  reduce  the  magnitude  of 
eiTor  tremendously.  Furthermore,  the  modified  extended  Kalman  filter  scheme  was  able  to  capture 
the  upward  price  spike  in  the  neighborhood  of  time  t  =  250  days  better  than  the  EKF  scheme.  Both 
scheme  were  not  able  to  capture  the  upward  spike  around  the  time  t  =  800  days.  This  might  be  as 
a  result  of  the  kind  of  model  we  are  using  to  describe  the  dynamics  of  the  natural  gas  data  set.  The 
upward  spike  in  price  at  these  region  was  due  to  the  decline  in  production  of  natural  gas  and  the 
increase  in  demand  for  electricity  generation.  We  will  like  to  also  mention  one  disadvantage  with 
this  scheme.  It  is  computational  intensive. 
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Chapter  6 

Discrete  Time  Dynamic  Model  of  Statistics  Process  and  Applications 


6.1  Introduction 

Recently,  several  models  have  been  developed  to  investigate  the  volatility  process  described  by 
stochastic  differential  equations  [140]  and  stochastic  difference  equations  [38].  It  is  well-recognized 
that  volatility  is  predictable  in  many  asset  markets  [9].  Moreover,  it  is  observed  that  the  volatility 
predictability  varies  significantly.  Engle  [38]  developed  a  class  of  discrete-time  models  where  the 
variance  depends  on  the  past  history  of  state  of  commodity /service.  Bollerslev  [9]  generalized 
models  in  [38]  to  the  GARCH(p,q). 

Using  the  concept  of  moving  average,  the  estimate  for  the  variance  of  a  general  statistics  from  a 
stationary  sequence  is  obtained  [13].  Employing  the  batched  mean,  the  grand  mean  of  the  individual 
batch  mean  and  introducing  ASAP3  [122],  it  is  shown  that  ASAP3  fits  AR(1)  time  series  model  to 
the  batch  mean,  and  it  provides  better  technique  for  points  and  confidence-interval  estimators. 

It  is  well  known  and  well  recognized  [33,  82,  118]  that  the  Kalman  filtering  approach  for  the 
system  parameter  and  state  estimation  problems  is  based  on  the  continuous  time  coupled  system  of 
state  dynamic  and  observation  systems.  Using  the  batched  mean  and  the  first  order  iterative  process 
for  Xn  [137],  a  first  order  iterative  process  [137]  is  developed  to  estimate  the  population  variance 
from  a  given  time  series  data  set. 

For  the  past  40  years,  researchers  [7,  15,  21,  33,  44,  45,  47,  55,  86,  87,  89,  95,  103,  104,  105, 
106,  107,  116,  118,  122]  have  paid  lot  of  attention  for  estimating  continuous-time  dynamic  models 
from  discrete  time  data  sets.  The  Generalized  Method  of  Moments  (GMM)  developed  by  Hansen 
[44],  and  its  extensions  [21,  45,  47,  55]  have  played  a  significant  role  in  the  literature  related  to 
the  parameter  and  state  estimation  problems  in  linear  and  nonlinear  stochastic  dynamic  processes. 
Under  the  continuous-time  dynamic  and  discrete  time  data  collection  processes,  the  GMM  and  its 
extensions/generalizations  consist  of  :  1.  Stochastic  differential  equations  of  Ito-Doob  type,  2. 
Euler-type  discretization  scheme,  3.  the  general  moment  function,  4.  minimizing  functional  or 
objective  criterion  function  [44,  47], 
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The  most  of  the  existing  parameter  and  state  estimation  techniques  except  the  Kalman  filtering 
arc  centered  around  the  usage  of  either  overall  data  sets  [21,  45,  47,  55],  or  batched  data  sets  [13], 
or  local  data  set  [107]  drawn  on  an  interval  of  finite  length  T.  This  leads  to  an  overall  parameter 
estimate  on  the  interval  of  T.  In  this  work,  the  presented  approach  is  focused  on  the  local  moving 
lagged  restriction  of  a  finite  sequence  of  a  data  set  drawn  at  a  partition  P  of  finite  interval  of  length 
T  to  a  subpartition  of  P  of  moving  subinterval  [tk-mki^k-\]  °f  the  interval.  Moreover,  using  the 
lagged  adaptive  process,  the  present  work  initiates  the  technique  to  estimate  the  parameter  and  state 
at  each  data  point  for  the  given  data  set.  Of  course,  these  parameter  estimates  depend  on  the  local 
admissible  lagged  finite  restricted  sequence  of  data.  As  the  sub-partition  moves  from  left  to  right, 
the  approach  provides  a  more  lagged  data  subsets.  In  fact,  the  available  lagged  data  subset  at  the 
previous  time  is  a  subset  of  the  available  lagged  data  subset  at  the  subsequent  times.  The  character¬ 
istics  of  this  approach  reduces  the  local  error  between  a  simulated  value  of  the  state  of  the  system 
corresponding  to  the  local  available  lagged  restricted  sequence  of  data  under  subpartition  and  pre 
determined  performance  criterion.  We  finally  note  that  at  the  left  end  point  of  data  simulation  inter¬ 
val,  without  loss  in  generality,  it  is  assumed  that  there  is  at  least  three  data  points  that  arc  assumed 
to  be  close  enough  to  the  true  values  of  solution  process  of  continuous  dynamic  process.  In  general, 
this  is  assured  by  the  uniqueness  and  continuous  dependence  of  solution  process  with  respect  to  the 
initial  data  (to,  ip0)  (for  delay  stochastic  differential  equation)  and  (to,  y0)  (in  the  absence  of  delay 
stochastic  differential  equation)  [70].  Moreover,  as  the  location  of  data  point  approaches  close  to  the 
right  end  point  of  the  time  interval,  the  local  admissible  lagged  finite  restricted  sequence  approaches 
to  the  given  data  set.  We  remark  that  this  situation  does  not  affect  the  computational  ability.  This  is 
due  to  the  fact  that  as  the  longativity  of  the  past  history  approaches  to  the  given  data  set,  its  influ¬ 
ence  diminishes.  In  fact,  simulation  value  approaches  to  the  saturation  level  under  the  performance 
criterion. 

The  presented  local  lagged  adapted  GMM  method  is  based  on  the:  1.  development  of  stochastic 
mathematical  model  of  continuous  time  dynamic  process  [69, 70],  2.  utilizing  Euler-type  discretized 
scheme  [58]  for  the  stochastic  model  in  1,  3.  developing  discrete  time  interconnected  dynamic 
model  for  statistic  process,  4.  employing  lagged  adaptive  expectation  process  [88]  for  develop¬ 
ing  generalized  moment  equations,  5.  conceptual  computational  parameter  estimation  problem,  6. 
conceptual  computational  state  simulation  scheme,  and  7.  mean  square  e-sub  optimal  procedure. 

The  present  work  is  motivated  by  parameter  and  state  estimation  problems  of  continuous  time 
nonlinear  stochastic  dynamic  model  of  energy  commodity  markets  described  in  (4.11).  The  pur- 
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pose  of  the  parameter  and  state  estimation  problems  is  for  model  validation  rather  than  model 
mis-specification  [21].  For  the  continuous-time  dynamic  model  validation,  we  need  to  utilize  the 
existing  real  world  data  set.  Of  course,  the  real  world  data  set  is  drawn/recorded  at  discrete-time  on 
a  time  interval  of  finite  length.  In  view  of  this,  employing  the  stochastic  numerical  approximation 
scheme  [58],  we  approximate  the  continuous  time  stochastic  differential  equations.  In  almost  real 
world  dynamic  modeling  problems  [64,  69,  70,  88],  future  states  of  continuous  time  dynamic  pro¬ 
cesses  arc  influenced  by  the  states  past  history  and  response/reaction  time  delay  processes  to  present 
states  [64,  88].  Under  this  assumption  and  using  the  concept  of  lagged  adaptive  expectation  process 
[47,  88],  we  formulate  a  discrete-time  observation  system.  In  fact,  the  discrete-time  dynamic  mod¬ 
els  depend  on  the  past  history  of  the  state  of  a  system  [59].  By  using  the  method  of  moments  [14], 
and  the  constructed  observation  system,  we  estimate  the  state  and  its  parameters.  This  idea  leads  to 
the  development  of  interconnected  disctete-time  dynamic  model  of  local  sample  mean  and  variance 
statistic  processes.  One  of  the  by-products  of  the  discrete-time  sample  variance  statistic  process  is 
that  it  provides  an  alternative  approach  to  the  GARCH(1,1)  model  [9,  10].  Furthermore,  the  usage 
of  the  continuous-time  stochastic  dynamic  model  [69,  70],  lagged  expectation  process,  rrij,.-  local 
lagged  generalized  method  of  moments,  and  interconnected  discrete-time  dynamic  model  of  local 
sample  mean  and  variance  statistics  processes  lead  to  an  alternative  innovative  method  of  state  and 
parameter  estimation  problems  for  continuous-time  dynamic  models  described  by  stochastic  differ¬ 
ential  equations.  The  developed  method  is  referred  as  local  lagged  adapted  generalized  method  of 
moments  (LLGMM).  The  numerical  approximation  process  and  simulation  processes  need  to  be 
synchronized  with  the  existing  data  collection  process.  Using  a  schedule  synchronization  process, 
the  concepts  of  local  admissible  sample/data  observation  size,  local  admissible  finite  conditional 
restriction  sequence  of  data  set  are  introduced.  We  estimate  the  parameters  locally  and  then  deter¬ 
mine  the  local  e-sub-optimal  simulated  state  estimates.  In  fact,  our  approach  is  more  suitable  and 
robust  for  forecasting  problem.  It  also  provides  upper  and  lower  bounds  for  the  forecasted  state  of 
the  system. 

The  organization  of  this  study  is  as  follows: 

In  Section  6.2,  we  derive  a  discrete  time  dynamic  model  for  sample  mean  and  variance  pro¬ 
cesses.  We  introduce  a  new  concept  of  parameter  and  state  estimation  techniques.  This  new  concept 
is  motivated  by  the  parameter  and  state  estimation  problems  of  continuous  time  non-liner  stochas¬ 
tic  dynamic  process.  In  Section  6.3,  we  construct  observation  system  from  a  nonlinear  stochastic 
functional  differential  equations.  In  addition,  using  the  method  of  moments  [14],  in  the  context  of 
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lagged  adaptive  expectation  process  [88],  we  briefly  outline  a  procedure  to  estimate  the  state  param¬ 
eters  locally.  The  conceptual  computational  and  simulation  schemes  arc  presented  in  Section  6.4. 
Moreover,  a  conceptual  Matlab  code  and  its  implementation  scheme  arc  designed.  The  usefulness 
of  computational  algorithm  is  illustrated  by  applying  the  code  to  four  energy  commodity  data  sets, 
U.S.  Treasury  Bill  Yield  Interest  Rate  data  set,  and  U.  S.  Eurocurrency  Exchange  Rate  data  set  for 
the  state  and  parameter  estimation  problems.  Moreover,  we  compare  the  usage  of  GARCH(1,1) 
model  with  the  presented  model.  Furthermore,  we  compare  our  simulated  volatility  U.S.  Treasury 
Bill  Yield  Interest  rate  data  with  the  simulated  work  of  Chan  et  al  [15]. 

6.2  Derivation  of  Discrete  Time  Dynamic  Model  for  sample  mean  and  variance  Processes. 

In  this  section,  we  use  the  idea  of  moving  average  to  derive  an  algorithm  for  the  mean  and  variance 
of  sample  sequences  with  respect  to  a  continuous  stochastic  process.  The  development  of  idea  and 
model  of  statistic  for  mean  and  variance  processes  is  motivated  by  the  state  and  parameter  estimation 
problems  of  continuous  time  nonlinear  stochastic  dynamic  model  of  the  energy  commodity  market 
described  in  (4.11).  In  addition,  the  problem  of  price  forecasting  of  energy  goods  is  also  addressed. 
For  this  purpose,  we  need  to  introduce  a  few  definitions  and  notations. 

Let  r  and  7  be  finite  constant  time  delays  such  that  0  <  7  <  r.  Here,  r  characterizes  the 
influence  of  the  past  performance  history  of  state  of  dynamic  process,  and  7  describes  the  reaction 
or  response  time  delay.  In  general,  these  time  delays  arc  unknown  and  random  variables.  These 
types  of  delay  play  a  role  in  developing  mathematical  models  of  continuous  time  [64]  and  discrete 
time  [59,  88]  dynamic  processes.  Based  upon  the  practical  nature  of  data  collection  process,  it  is 
essential  to  either  transform  these  time  delays  into  positive  integers  or  design  the  data  collection 
schedule  in  relations  with  these  delays.  For  this  purpose,  we  describe  the  discrete  version  of  time 
delays  of  r  and  7  as 


+  1,  (6.1) 

respectively.  Moreover,  for  the  sake  of  simplicity,  we  assume  that  0  <  7  <  1  (q=l). 

DEFINITION  6.2.1  Let  x  be  a  continuous  time  stochastic  process  defined  on  an  interval  [— r,  T] 
into  R,  for  some  T  >  0.  For  t  £  [— r,  T\,  let  Ft  be  an  increasing  sub-sigma  algebra  of  a  complete 
probability  space  (fi,  F.  V)  for  which  x(t)  is  Ft  measurable.  Let  P  be  a  partition  of[— r,  T ]  defined 


r  = 


A  U 


+  1,  and  q  = 


7 


A  L 
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by 

P  :=  {U  =  to  +  zAt},  /or  z  €  /(— r,  A),  (6.2) 

where  At  =  mzd  /(a,  6)  is  defined  by  I(a,b)  =  {j  G  Z  |  a  <  j  <  b}. 

Let  {x(tj)}^_r  be  a  finite  sequence  corresponding  to  the  stochastic  process  x  and  partition  P 
in  Definition  6.2.1.  We  further  note  that  x(U)  is  7/  measurable  for  %  G  /(— r,  N).  We  recall  the 
definition  of  forward  time  shift  operator  F  [1 1]  : 

Flx{tk)  =  x(tk+i).  (6.3) 

In  addition,  let  us  denote  x(U)  by  xt  for  z  G  /(— r,  N). 

Definition  6.2.2  For  q  =  1  ond  r  >  1,  each  k  G  Iq(N)  and  each  mk  G  1(2,  r  +  k  —  1),  a 
partition  Pk  of  closed  interval  [tk-mkfk-i\  is  called  local  at  time  tk  and  it  is  defined  by 

Pk  :=  tk—mk  <  tk—mk+ 1  <  <  ffc— 1-  (6.4) 

Moreover,  Pk  is  referred  as  the  mk  —point  sub-partition  of  the  partition  P  in  (6.2)  of  the  closed 
sub-interval  [4_mfe,4_ t]  of[-r,T\. 


Definition  6.2.3  For  each  k  G  Iq(N)  and  each  mk  G  1(2,  r  +  k  —  1),  a  local  finite  sequence  at 
a  time  tk  of  the  size  mk  is  restriction  of  {x(ti)}fL_r  to  Pk  in  (6.4)  [2],  and  it  is  defined  by 

Smk,k  '■=  {P  xk-l}i=-mk+l-  (6-5) 


Ai  mk  varies  from  2  to  k+r—l,  the  corresponding  local  sequence  Smktk  at  tk  varies  from  {xi]\zl_2 
to  {xi}^Z^r+1.  As  a  result  of  this,  the  sequence  defined  in  (6.5)  is  also  called  a  mk-local  moving 
sequence.  Furthermore,  the  average  corresponding  to  the  local  sequence  Srrih  jc  in  (6.5)  is  defined 


Smk,k  :=—  V  Flxk. 
mk  .  ^ 

i=—rrik  + 1 


The  average/mean  defined  in  (6.6)  is  also  called  the  mk-local  average/mean.  Moreover,  the  mk- 


local  variance  corresponding  to  the  local  sequence  Smk,k  in  (6.5)  is  defined  by 


„2 

°mk,k  • 


—  \Flxk-i-—  FJxk- 1  ,  far  small  mk 

i=—mk+ 1  \  j=~mk  + 1  / 


0 

E 

i=-mk  + 1 


Flxk-i  -  —  E  F*xk- 1  ,  for  large  mk 

j=-mk+ 1  J 


65 


DEFINITION  6.2.4  For  each  fixed  k  £  1(0,  N),  and  any  m &  £  I-2(k  +  r  —  1),  die  sequence 
{Si,k}i=k-mk  *s  caH£d  a  mk—  local  moving  average/mean  process  at  t^.  Moreover,  the  sequence 
isi  k}i=k-mk  *s  caU£d  a  mk~  local  moving  variance  process  at  t^. 

DEFINITION  6.2.5  Let  {x(ti)}fL_r  be  a  random  sample  of  continuous  time  stochastic  dynamic 
process  collected  at  partition  P  in  (6.2).  The  local  sample  average/mean  in  (6.6)  and  local  sample 
variance  in  (6.7)  are  called  discrete  time  dynamic  processes  of  sample  mean  and  sample  variance 
statistics. 

DEFINITION  6.2.6  Let  {x(ti)}fL_r  be  a  random  sample  of  continuous  time  stochastic  dynamic  pro¬ 
cess  collected  at  partition  P  in  (6.2).  The  rrik-local  moving  average  and  variance  defined  in  (6.6) 
and  (6.7)  are  called  the  m^-local  moving  sample  average/mean  and  local  moving  sample  variance 
at  time  t^,  respectively.  Moreover,  m^-local  sample  average  and  nq.- local  sample  variance  are  re¬ 
ferred  to  as  local  sample  mean  and  local  sample  variance  statistics  for  the  local  mean  and  variance 
of  the  continuous  time  stochastic  dynamic  system  at  time  tk,  respectively. 

In  the  following,  we  derive  a  dynamic  algorithm  described  by  the  interconnected  discrete-time 
local  conditional  sample  average/mean  and  variance  dynamic  processes.  First,  we  shall  state  and 
prove  a  change  in  Srt,kj.  and  k  with  respect  to  change  in  time  tk-  This  fundamental  result  is 
motivated  by  Exercise  5.15  in  [14]. 

Definition  6.2.7  Let  {E[x(fj)|Jrti_l]}^_r.+1  be  a  conditional  random  sample  of  continuous  time 
stochastic  dynamic  process  with  respect  to  sub-o  algebra  Fq,  U  £  P  in  (6.2).  The  m^-local 
conditional  moving  average  and  variance  defined  in  the  context  of  (6.6)  and  (6.7)  are  called  the 
m^-local  conditional  moving  sample  average/mean  and  local  conditional  moving  sample  variance, 
respectively. 

Lemma  6.1  (Discrete  Time  Dynamic  Model  of  Local  Sample  Mean  and  Sample  Variance  Pro¬ 
cess).  Let  {E[x(fi)| Fti-iftfL-r+i  be  a  conditional  random  sample  of  continuous  time  stochastic 
dynamic  process  with  respect  to  sub-o  algebra  Fq,  U  belong  to  partition  P  in  (6.2).  Let  Smktk  and 
smk  k  atk-local  conditional  sample  average  and  local  conditional  sample  variance  at  for  each 
k  £  1(0,  N).  Then,  an  interconnected  discrete  time  dynamic  model  of  local  conditional  sample 
mean  and  sample  variance  statistics  is  described  by 
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5, 


mk—p+i  ,fc— p+1 


_  f^k—p 


5 rrik,k 


mk_p+ 1  Smk_p,k-p  +  Vmk-p,k-p,  Smo,0  ~  Sq 
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E 
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„2  1  mk_p 

i  — 1 
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n  mfc-j 

n  mfc-j 

.1=0 

1=0 

+Zmk_uk-1,  for  large  mk,  mk_ i  < 

:>mk_p,k-p 


s2v  j  =  s2,  ?'  G  /_p(0),  initial  conditions 


k.  mi, i 


(6.8) 


where 

Vmk_p,k-P  =  mk_p+ 1 


1 


£  u  ,  =  mk~ 1 


Wlk — 

E  ^k-p  -  F-^-P+1xfc_p  -  F~mk-rxk.p  +  F°xk.p 

i=—mk-p+ l+l 


E  i-l 
4=1  n  mk-j 


-E 

2=1 


+ 


mk—l 

mfc 


P 

E 

2=1 


i-l 

n  m*;-j 
1=0  1=0 
—  i+2 -mk_i 

E  (F‘*fc_i)2 
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i-l 

n  mfe-j 

1=0 
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V 

E 
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i-l 

n  mk_j 
1  =  0 


p 

+  E 
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”<+! 

E  Flxk-iFsxk-i 

l,s=-i+2-mk-i+1 

l^S 

i—  1 

n  mk-j 

1=0 


-  ri  E  F*Xfc_iFaSfc_i, 


l,s=— m/j+1 
l^s 


emk_1,k-l  ~  E  i-l 

i=i  n  mi=-. 


P  (F-^fc-if  V-  (^+1~mfc-^fc-1)  A  (F-4+2~mfc-4 


-E 

2=1 


J=0 
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-E 
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®fc-l 


i-l 
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1=0 
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-i+2-mfe_i 

E  (F^fc-l)2 

i=-i+2-mfc_i+1 

p 

+  E 

r  -i+i  ,  i 

E  Flxk-1Fsxk—1 

l,s=-i+2-mk_i+1 
l^S 

i-l 

i-l 

n  mk—j 

2=1 

n  mk~j 

1=0 

1=0 

-sr=i  £ 


l,s=— m/c+1 
l^s 


(6.9) 


Proof.  The  proof  of  Lemma  6.1  for  small  rnk,  mk_ i  <  m/;.,  is  given  in  (7.1.  The  case  for  small  mk, 
mk  <  m/.._  i  is  also  described  in  (7.2.  The  proof  for  large  mk,  mk- \  <  rnk,  is  given  in  (7.3.  □ 
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Remark  12  The  interconnected  system  (6.8)  can  be  re-written  as  the  one-step  Gauss-Sidel  dy¬ 
namic  system  [62]  of  iterative  process  described  by 


X(k)  =  A (k,  X(k  -  1  ))X(k  -  1)  +  e(jfe), 


where 


Aai(fc)  =  { 


X(k) 

X\(k) 


A(fc,  X(k  —  1)) 

An(fe) 

(  0 
0 


Is 2  \ 

mk_p+1,k-p+l 

S2 

c’mk_p+2,k-p+2 


X2(k)  = 


s2 

rrik—i,k—l 


s2 

rrifck 


J 


An  (k)  Ai  2{k)' 

lA21(fc,X(fc-l))  A22(fc), 

Ai2(fc)  =  (0  0 
mfc  -  p  +  1  V 

\ 


0 

(mk-l)mk_p  Q 

P-l  ‘->mk_p,k—p 

mk  II  mk-j 

3=0  ) 


for  small  mk 


0 

0 


\ 


0 

p^i  Dmk_p,k-p 

\  n  mk—j  i 

\j=0  ) 


for  large  mk , 


(6.10) 
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A22  (k) 
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Remark  13  For  each  k  e  7(0,  A"),  p  =  2  and  small  mj-,  the  inter-connected  system  (6.8)  reduces 
to  the  following  special  case: 


Smk-i,k-l 

~  mfc_i  Smk-2,k—2  +  r)mk-2,k—2i  5+0,0 

S2 

mfc  —  1 

TOfc-l  „2  ,  mk—2  „2 

rrik,k 

mk  u’mk-1,k-l  mkmk_i  °mk 

l.fc-1*  sL,i  =  sf,  i  €  I- 2(0), 

mk- 2  c2 

mkmk_ i  °mk- 2,k—2 


(6.11) 


where 
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Vmk_2,k—2 
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mk- 1 
mk 
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E  ^*fc-2  -  F-m*-»+1Xfc_2  -  2  +  F°.Tfc_2 

i=-mfc_i+l 
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mk 
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Remark  14  Define  c?i  =  ^  = 

~  1  )7lfc  nik  ~ 


_  mk  —  1  rrik-2 


™fc-2 


,  and  w;i  = 

mfc  mfcm.fc_i  ’  ~ °  mfc_i 


.  For  small  mk. 


mk- 1  <  mk,  Vfc,  we  have  991  <  1,  ip2  <  1,  and  <^3  <  1.  From  0  <  <pi,  i  =  1,  2,  3,  and  the  fact  that 
<Fi  +  <F2  =  mfc_i  +  [mfc_i  +  1]  <  <  1,  the  stability  of  the  trivial 

solution  (X(k)  =  0)  of  the  homogeneous  solution  corresponding  to  (6.10)  follows.  Moreover, 
under  the  stated  condition,  the  convergence  of  solutions  of  (6.10)  also  follows. 


Remark  15  Also,  (6.11)  can  be  re-written  as 

X(k)  =  A (fc,  X(fc  -  l))X()fe  -  1)  +  e(ife),  (6.12) 

/ Xi(fe)\ 

where  X(fc),  A (k)  and  e(k)  are  defined  by  X(fc)  =  I ,  Xi(fe)  =  Smk  l  k-i,  X2 (/c)  = 

Vx2(fe)/ 
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Remark  16  From  Remark  13,  we  note  that  the  local  sample  variance  statistics  at  time  A  depends 
on  the  state  of  the  mk- 1  and  m/._2-local  sample  variance  statistics  at  time  tk-i  and  t/i:_2,  and  the 
m/._2-local  sample  mean  statistics  at  time  tk-2-  We  shall  later  compare  the  ////--local  sample  vari¬ 
ance  statistics  with  the  GARCH(p.q)  model  and  show  that  the  ////.-local  sample  variance  statistics 
gives  a  better  forecast  than  the  GARCH(p,q)  model  under  the  usage  of  simulating  a  real  data  set. 


70 


6.3  Parametric  Estimation 


In  this  section,  we  consider  a  parameter  estimation  problem  in  drift  and  diffusion  coefficients  of  a 
very  general  continuous-time  nonlinear  stochastic  dynamic  model  described  by  a  systems  stochastic 
differential  equations.  This  problem  is  motivated  by  the  continuous-time  dynamic  model  validation 
problem  described  in  (4.11)  in  the  context  of  energy  commodity  real  data  set.  This  is  achieved  by 
utilizing  the  lagged  adaptive  process  [88]  and  the  interconnected  discrete-time  dynamics  of  local 
sample  mean  and  variances  statistic  processes  model  in  Section  6.2  (Lemma  6.1).  We  consider  a 
general  system  of  stochastic  differential  equations  under  the  influence  of  hereditary  effects  in  both 
the  drift  and  diffusion  coefficients  described  by 

dy  =  f(t,yt)dt  +  a(t,yt)d\V(t),yto  =  (p0,  (6.13) 

where  yt(0)  =  y(t  +  0),  0  G  [— r,  0],  f ,  a  :  [0,  T]  x  C  — >•  M9  are  Lipschitz  continuous  bounded 
functionals;  C  is  the  Banach  space  of  continuous  functions  defined  on  [— r,  0]  into  M9  equipped  with 
the  supremum  norm;  W (t)  is  standard  Wiener  process  defined  on  a  complete  filtered  probability 
space  (Q,F,  (Ft)t> ip0  G  C,  and  y0(fo  +  Q)  is  measurables;  the  filtration  function 
(J-)t>0  is  right-continuous,  and  each  Ft  with  t  >  to  contains  all  V-mx\\  sets  in  F\  the  solution 
process  y(fo,  Fo){t)  °f  (6.13)  is  adapted  and  non-anticipating  with  respect  to  {Ft)t> o- 

Let  V  G  C[[— t,  oo]  x  M9,  Mm],  and  its  partial  derivatives  V),  exist  and  arc  continuous. 

We  apply  Ito-Doob  stochastic  differential  formula  [70]  to  V  ,  and  we  obtain 

dV(t,y )  =  LV(t,y,yt)dt  +  Vy(t,y)a(t,yt)dW(t)  (6.14) 

where  the  L  operator  is  defined  by 

f  LV(t,y,yt )  =  Vt(t,y)  +  Vy(t,y)f(t,yt)  +  \tr{Vyy(t,y))b{t,yt) 

<  (6.15) 

For  (6.13)  and  (6.14),  we  present  the  Euler-type  discretization  scheme  [58]: 

|  Ay {  =  f(ti-i,yt._1)Aii  +  <r(ti_1,yt._1)AWi_i,  i  G  h{N) 

\  A V(ti,y(ti))  =  LV{ti-i,y(ti),yti_1)/S.ti  + 

(6.16) 

Define  Fti_1  =  F,-\  as  the  filtration  process  up  to  time  t.,_  i .  With  regard  to  the  continuous  time 
dynamic  system  (6.13)  and  its  transformed  system  (6.14),  the  more  general  moments  of  Ay (tj)  arc 
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as  follows: 


E[  Ay(ti)|J-i_i] 

E  [(Ay(tj)  —  E  [Ay(tj)|Jrj_i])  x 
(Ay(fi)-JE[Ay(fi)|J't_1])T|j;_1 

E[AV(ti,v(ti))\ri-i] 

E  [(A V(ti,  y{ti ))  -  E  [AVituyiU))^})  X 
(AV(U,  y(U))  -  E  [A V(ti,  y(^))|^_i])T  |^_i 


o-(U-i ,  yu-i  )aT  (U-i,  )  Ati, 

(6.17) 


where  yti_J  =  r/(fj_i))&(fj_i,  y(^_i))TA^,  and  T  stands 

for  the  transpose  of  the  matrix. 

From  (6.16)  and  (6.17),  we  have 


I  Ay,  =  EiAyiU)^} +  a(ti_1, i  €  h(N) 

\  A V(ti,y(ti))  =  E[AV(ti,y(ti))\Ei-1\  +  Vy(ti-.i1y(ti-i))a(ti-i,yti_1)AW(ti) 

(6.18) 

This  provides  the  basis  for  the  development  of  the  concept  of  lagged  adaptive  expectation  process 
[88]  with  respect  to  continuous  time  stochastic  dynamic  systems  (6.13)  and  (6.14).  This  indeed 
leads  to  a  formulation  of  m/,.- local  generalized  method  of  moments  at  tk ■ 


Example  1: 

n 

For  V (t,  y)  in  (6.14)  is  defined  by  V(t,y)  =  \\y\\p  =  W\p-  In  this  case,  we  have 


dV  = 


dt 


l=i 


Pj2\vj\p  1sgn(yj)f(t,yl)  +  '^E^-\y^\P  2a{t,yJt) 
i=i 

71  . 

+pE  \y3\p~1sgn(yJ)a(t,y3t)dW3 . 
l=i 

Hence,  the  discretized  form  of  (6.19)  is  given  by 

AV-,  =  pjr  \yi_1\P^sgn(yj_1)f(ti-1,yii_J  +  ^^\y3i_1\P-2a(ti^1,y3t._1) 
j= 1 

n  ...  . 

+P  E  \yi-i\p~1sgn(yi_1)a(t^l,y3ti_1)dW^ 

l=i 


(6.19) 


dt 


(6.20) 
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In  this  special  case,  (6.18)  reduces  to 


Ay, 


A  IE  \vt 


71  p 


=  E  [Ay(ti)|^_i]  +  a-(ti-i,yti  l)AWi-i,  i  £  h(N) 

r  (  n  .  \  1 

=  E 


a  (  E  \yi\p J  1^-1 


+  P  E  \yJi-i\P  1sgn(yJi_1)a{ti-1,yJti_i)dW^. 

3= 1 

(6.21) 


Example  2: 


We  consider  AR(1)  model  as  another  example  to  exhibit  the  parameter  and  state  estimation  prob¬ 


lem.  The  AR(1)  model  is  of  the  following  type 


A,  —  ai-iXi-i  +  ej,  Xq  —  xq, 


(6.22) 


where  A,  are  Tt  measurable,  and  et  are  independent  white  noise  process  and  independent  of  xq. 


Hence 


E[Xi\Xi-\]  =  a,_iAj_i 

E  [XiX^Ei-i]  =  ai-iX, i^Xl.al,  +  E  [aef  |JE_i] 


(6.23) 


In  the  following,  we  state  a  result  that  exhibits  the  existence  of  solution  of  system  of  non  linear 
equations.  For  the  sake  of  easy  reference,  we  shall  re-state  the  Implicit  function  theorem  without 
proof. 

Theorem  6.1  Implicit  Function  Theorem[2]  Let  F  =  { F\ .  F->, ...,  Fq)  be  a  vector-valued  func¬ 
tion  defined  on  an  open  set  S  £  M9+fc  with  values  in  M9.  Suppose  F  <E  C\  on  S.  Let  (uq;vq)  be  a 
point  in  S  for  which  F(uq]Vq)  =  0  and  for  which  the  q  X  q  determinant  det  [DjFfiuQ]  Vo)]  0. 
Then  there  exists  a  k—  dimensional  open  set  Tq  containing  Vo  and  unique  vector-valued  function  g, 
defined  on  Tq  and  having  values  in  M9,  such  that  g  £  C\  on  Tq,  g(vo)  =  Uq,  and F(g(v)]v)  =  0  for 
every  v  £  Tq. 

6.4  Applications  for  Illustrations 

In  the  following,  we  give  specific  models  for  different  commodities  and  apply  the  method  of  mo¬ 
ments  to  estimate  their  parameters. 
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6.4.1  Application  1:  Dynamic  Model  for  Energy  Commodity  Price 

We  consider  a  stochastic  dynamic  model  of  energy  commodities  described  by  the  following  nonlin¬ 
ear  stochastic  differential  equation 

dy  =  ay{y  -  y)dt  +  a(t,  yt)ydW(t),  yto  =  <^0,  (6-24) 

where  yt(0)  =  y(t  +  9);  9  G  [— r,  0],  n,a  e  M;  the  initial  process  ip0  =  {y(to  +  ^)}ee[-r,o]  is 
-measurable  and  independent  of  {W (t),t  €  [0,  T] } ;  W it)  is  a  standard  Wiener  process  defined 
on  a  filtered  probability  space  (fi,  F,  (Ft)t>o,F)  defined  in  (6.13);  a  :  [0, T]  x  C  -»  M+  is  a 
Lipschitz  continuous  and  bounded  functional;  C  is  the  Banach  space  of  continuous  functions  defined 
on  [— r,  0]  into  M  equipped  with  the  supremum  norm. 

We  pick  a  Lyapunov  function  V (t,  y)  =  lnfy)  in  (6.14)  for  (6.24).  Using  ltd-differential  formula 
[70],  we  have 

d  (ln(y))  =  a(y,  -  y)  -  ^cr2(>,  l h)  dt  +  a(t,  yt)dW (t).  (6.25) 

By  setting  A L  =  f  j  —  f  j_ i,  Ay,  =  y.i  —  yt_  i ,  the  combined  Euler  discretized  scheme  for  (6.24)  and 
(6.25)  is 

{A yi  =  a?/i_i(/i  -  r/i_i)AU  +  cj(fi_i,yti_1)r/,_iAlU(fi),  yto  =  <p0, 

A(1  n(yi))  =  [a(n-yi-i)  -  At*  +  a (U-i,  y t^) AW (ti),yto  =  ip0. 

(6.26) 

where  =  {y,;}'J=_r  is  a  given  finite  sequence  of  Fq—  measurable  random  variables,  and  it  is 
independent  of  {AVU(fj}^1. 

Applying  conditional  expectation  to  (6.26)  with  respect  to  Fti_1  =  Fi-\,  we  obtain 


E  [Ayjl^j-i] 

E  [A  (Info))  |^_i] 

E  [(A  (ln(yi))  -  E  [A  (]n(Vi))  l-^-i])2  l^-i 

From  (6.27),  (6.26)  reduces  to 


ayi- i(n  -  yi-\)At 

[a{y  -  i)  -  2a2(fi_i,  At 

cr2(U_i,r/t;_i)Af. 

(6.27) 


Ay%  =  E[Ayi\Fi-i\  +  cr{ti-i,yti_1)yi-iAW(ti) 

<  (6.28) 

[  A  (ln(y*))  =  E  [A  (ln(y*))  \Fi-i]  +  o-(L_i,yfi_1)AlU(L). 

(6.28)  provides  the  basis  for  the  development  of  the  concept  of  lagged  adaptive  expectation  pro¬ 
cess  [88]  with  respect  to  continuous  time  stochastic  dynamic  systems  (6.24)  and  (6.25). 
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For  k  £  1(0,  N),  applying  the  lagged  adaptive  expectation  process  [88],  from  Definitions  6.2.3  — 
6.2.7,  and  using  (6.8)  and  (6.28),  we  formulate  a  local  observation/measurement  process  at  f*. 
as  a  algebraic  functions  of  mj~- local  functions  of  restriction  of  the  overall  finite  sample  sequence 
{Vi}iL-r  to  subpartition  in  Definition  6.2.2  : 


nV  E 


mk  . 

i=k—mk 

k- 1 


=  a 


^  E  E  [A  (ln(yi))  |E-i]  =  a 


i=k—rrik 


k— 1  fc— 1 

^  E  i/i-i  -  E  /yf  i 

i=k—m fc  i=k—m 


At, 


k—l 

F  -  E  Vi-i 


i=k—m fc 


At 


fc-i 


“2i77  E  E  (A(ln(y,))-E[A(ln(yJ))|^_1])2|J-8_1 

i=k—m^  L 


(6.29) 


t-2 


Aj-1 


XI  E  (A  (ln(^))  -  E  [A  (ln(y*))  |  Ji_i])2  |7i_i  if  mk  is  small 

i=k—m^  L  J 

E  E[(A(ln(yi))-E[A(ln(r/i))|^_i])2|^_i 

i=k—rrik  L 


if  mk  is  large. 

(6.30) 


From  (6.30),  it  follows  that  the  average  volatility  square  afUk  k  is  given  by 


~  2  _  rnk,k 

amk,k  ^  ’ 


(6.31) 


where  .s2(/  is  the  local  sample  variance  statistics  for  volatility  at  tj.  in  the  context  of  x{tj)  = 
A  (ln(y,;)).  We  define 


Fi  (E  [At/ilFi-i]  ,E  [A(ln  j/j)|  \a,n) 


< 


F2  (E  [Ayi\Fi-i] , E  [A(lny.j)|7:i_i]  ;a,/r) 


fc  —  1 

E  n^vAF-i] 


mk 
k- 1 

M  E  2/i-l 


—a 


E  vU 


mk 


mk 


k- 1 


Af 


^  E  E^lnyOI^-r] 

i=k—mk 


—a 


k- 1 

F  -  ^  E  Sfc-i 

i=k—rrik 


At 


S 2  . 

rafc,fc 


(6.32) 


Then  we  have 

j  Fx  (E  [Ai/ilEj-i]  ,E  [A(lnr/i)|Ei_i]  ;a,M)  =  0, 
)  F2  (E  [AyilEi-i]  ,E  [A(lnr/i)|Ei_i]  =  0. 


(6.33) 
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Let  F  =  {F\.  F->}.  The  determinant  of  the  Jacobian  matrix  of  F  is  given  by 


JF(a,n)  =  E  vL\  -  rrF  (  E  Vi- 1  (At) 


i=k—rrik 


i=k—rrik 


(6.34) 


=  -a  var{y(ti-i)ki=l_rrlk){/\t)2  ±  0, 

provided  that  a  /  0  or  the  sequence  {x(U- i)},E-r+i  is  neither  zero  nor  a  constant.  This  fulfils  the 
hypothesis  of  Theorem  6.1. 

Thus,  by  the  application  of  Theorem  6.1  (Implicit  Function  Theorem),  we  conclude  that  for  every 
non-constant  m/.- local  sequence  ,  there  exist  a  unique  solution  of  system  of  algebraic 

equations  (6.33),  amk,k  and  /tmfc ,k  as  a  point  estimates  of  a  and  //,  respectively. 

We  also  note  that  the  estimated  values  of  a  and  //  change  at  each  time  t/,:.  For  instance,  at  time 
t o  =  0  and  the  given  T- \  measurable  discrete-time  process  y_r  +i,y-r+2,-,y~i,  (6.29)-(6.30) 
reduce  to 


£  E  A  yi 


4  E  Vi- t-^o  E  yt i  A t, 

i——m  o  i=—rriQ 


A_  £  A(lnyj)  =  a  \i  -  ±  E  Vi-i  A i  - 

i=-mo  i=—mo 

,2 

-2  _  Smn,0 

,  CTm0,0  A t  ‘ 

The  initial  solution  of  algebraic  equations  (6.35)  at  time  to  is  given  by 


(6.35) 


®mo,0  — 


(4  E  A(ln2/i)+%S  )  (%  E  E  A yi 

\  z= —  rriQ  J  \  t=—m q  J  i=  —  m q 

4  E  E  s/i-i)  At 

u  m.Q  \i=  —  m  q  / 

4s  E  Adnj/d+^  +  ^f  E  Vi-i) 

z=  —  rriQ  \t=  —  m0  / 


_  *mg,0 


(6.36) 


At  time  ti  =  1  and  the  given  Fq  measurable  discrete-time  process  y_r,  y~r+\ , ...,  y_i,  yo,  (6.29)- 
(6.30)  reduce  to 


4  E  A  yi 


rrt  E  Vi-l-rk  E  3/i-l  At, 

7=1  —  777-1  7—1 — 777 1 


4  E  A(lnyj)  =  a  /r-A-  £  jfc-i  At  - 

7—1  —  777-1  7—1  —  777-1 


(6.37) 


_  m  i  ,i 

—  At  ' 
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The  solution  of  algebraic  equations  (6.37)  is  given  by 


®mi,l  — 


l^m  i,l  — 


^  E  A(lnW)+^)(^r  E  E  AVi 


_L_  V  iv2  V 

mi  a—'  —  1  mi  1  . 

4=1  — m^  u=l-m| 


2/4-1  At 


E  AdnyO+^  +  ^f  E  W-l 

4=1  — m^  \i=l  — mj_ 


_  m-j^ ,  j 

—  — at 


Likewise,  for  k  =  2,  we  have 


2,2  — 


m2  i=2-m2 


E  A(lnj/j)+- 


m2  4,1  1  m2  • 


dx  E  yf-1+irf  E  s/i— i )  U* 


^  yi-i-r^r  z.  f 
4=2  — m2  \  4=2  — m2 


E  A(ln^)+^3#+^?ri(  E  y<-i 


Mm  2?2  — 


_  6m2,2 


(6.38) 


(6.39) 


Hence,  from  (6.29)-(6.30)  and  applying  the  principle  of  mathematical  induction  [69],  we  have 


hr.  E  A(lnyi)+-=K  I  E  Vi-i  Kb  E  AV< 


E  A(lnJ/i)  +  ^ff  + 


2  At  '  mu 


E  2/i-l 


(6.40) 


Remark  17  We  note  that  without  loss  in  generality,  the  discrete-time  data  set  {'!)-,■ +%  :  *  €  I\{r  — 
1)}  is  assumed  to  be  close  to  the  true  values  of  the  solution  process  of  the  continuous-time  dynamic 
process.  In  fact,  this  assumption  is  feasible  in  view  of  the  uniqueness  and  continuous  dependence  of 
solution  process  of  stochastic  functional  or  ordinary  differential  equation  with  respect  to  the  initial 
data  [70]. 

Remark  18  If  the  sample  {yi}\=k-m  _i  *s  a  constant  sequence,  then  it  follows  from  (6.40)  and 

fc-i 

the  fact  that  A  (In  yl)  =  0  and  k  =  0,  that  fimk.k  —■ >  Ui-i>  and  it  follows  from 

i=k—rrik 

(6.29)-(6.30)  that  amkik  =  0. 

Remark  19  As  we  stated  before,  estimated  parameters  a,  q,  and  o1  depend  upon  the  time  at  which 


data  point  is  drawn.  This  is  what  we  expected  because  of  the  fact  that  nonlinearity  of  the  dynamic 
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model  generates  non  stationary  solution  process.  Using  this  locally  estimated  parameters  of  the 
continuous-time  dynamic  system,  we  can  find  the  average  of  this  local  parameters  over  the  size  of 
data  set  as  follows: 


'  N 

d  -  y  E 

i= 0 
N 

*  M  N  (6-41) 

i= 0 

_  N 

*2  =  fE  o^ti. 

i= 0 

a,  y,  and  a2  arc  referred  to  as  aggregated  parameter  estimates  of  a,  y,  and  a2  over  the  given  entire 
finite  interval  of  time,  respectively. 


6.4.2  Application  2:  Dynamic  Model  for  U.S.  Treasury  Bill  Yield  Interest  Rate  and  U.  S. 
Eurocurrency  Exchange  Rate 


We  also  apply  the  above  presented  scheme  for  estimating  parameters  of  a  continuous-time  model  for 
U.S.  Treasury  Bill  Yield  Interest  Rate  [128]  and  U.  S.  Eurocurrency  Exchange  Rate  [129]  processes. 
By  employing  dynamic  modeling  process  [69,  70],  a  continuous  time  dynamic  model  of  interest  rate 
process  under  random  environmental  perturbations  can  be  described  by 


dy  =  (I3y  +  yyS)dt  +  cry^dW  (t),y{to)  =  y0, 


(6.42) 


where  ft,  y,  5,  a,  7  £  M;  y(t.  to,  yo )  is  adapted,  non- anticipating  solution  process  with  respect  to  J 7t; 
the  initial  process  yo  is  Ft0 -measurable  and  independent  of  {W (t),t  £  [to,  T]  \  ;  IV (t)  is  a  standard 
Wiener  process  defined  on  a  filtered  probability  space  (Q.  T .  (J:)t>o,'P)- 


For  (6.42),  we  consider  the  Lyapunov  functions  V\  (t,  y)  =  ^ y  ,  and  V2 (t,  y)  =  as  in  (6.14). 
The  Ito  differentials  of  V),  for  i  =  1.2,  arc  given  by 

dV 1  =  [y(/3y  +  yy5)  +  \cr2y21]  dt  +  ay^+1dW (t) 

dV 2  =  [y2{py  +  yy5)  +  cr 2y2'r+1]  dt  +  ay1+2dW (■ t ). 

Following  the  approach  in  Section  6.3  and  illustration  6.4.1,  the  Euler  discretized  scheme  (At  = 
1)  for  (6.42)  is  defined  by 


(6.43) 


Ayi  =  (Pyi- 1  +  dVi-i)  +  ayl.AW  (U) 

1 A(yf )  =  yi-i(/3yi-i  +  yyf_^  +  \cr2yfli  +  cry^AWi 
{  lA(vf)  =  y?-i(Pyi-i  +  yyti)  +  °2yi-il  +  vvi-i  AWi. 


(6.44) 
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Applying  conditional  expectation  to  (6.44)  with  respect  to  we  obtain 


E  [Aj/j| 

5®  [A(y2)|J)_i] 
5E  [A(yf)|  Ji-r] 


E 


[(A^-EfAj/il^!])^^! 
jA(y2)-E[A(y2)])2|^_1 
From  (6.45),  (6.44)  reduces  to 


|E 


=  Pyi- 1  +  F2/f-i 

=  1  +  wSi- 1  +h2  yf- 1 

=  PvU  +  ^  +  ^lt1 
=  °2yV-  1, 

=  -2^f  • 


(6.45) 


Ay*  =  E  [Ayil^-i]  +  o-y7_iAVF(ti) 

<  ±A(y2)  =  iE[A(y2)|^_1]  +ay]+11AWl  (6.46) 

jA(y,3)  =  lEfA^I^+tr^AWi. 

Following  the  argument  used  in  (6.29)-(6.30),  for  k  G  1(0,  N),  applying  the  lagged  adaptive 
expectation  process  [88],  from  Definitions  6.2.3  —  6.2.7,  and  using  (6.8)  and  (6.45),  we  formulate 
a  local  observation/measurement  process  at  tk,  as  a  algebraic  functions  of  m/,.- local  functions  of 
restriction  of  the  overall  finite  sample  sequence  {yi}fL~r  to  subpartition  F).  in  Definition  6.2.2: 


i=k—mk 


k- 1 

—  V 

2771/2  ' 

i=k—mk 


E[A  (yDl^-r] 


E 


E[Ay,;|J)_1])2|J)_1 


< 


1 

mk 


k- 1 

E 

i=k—mk 


lE  [A (yf)\Fi-i] 


-*2y 


27+1 

i—  1 


Wk -  E1  E[(A2/i-E[Ayi|^i_1])2|^i_1 

i=k—mk  L 


fc-1 


E  E  I  (A(y?)  -  E  [A(y?)])  I-T7*— i 

i=k—m k  L 


/?- 


+y- 


P1 


+y- 


k- 1 

E  2/i-l 

=k—mjt 

mk 

k-1 

E  2/i-i 

~mfc 

mk 

k-l 

E  3/f_! 

-k—rrifc 

mk 
k-l 

E 

i=k  —  m 


E  i/£? 


k 

mk 


k-l 


E  vU 


P- 


mk 

k-l 


E  t/Ei2 


+y- 


mk 


E  1/& 


<T 


<7 


mk 

k-l 


E 


27+2 


«*fc 


(6.47) 
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Following  the  approach  discussed  in  Section  6.4.1,  the  solution  of  crmk,k  is  given  by 


k—  1  9 

1  vymk’k 

mk  "i—1 

i=k—mk 


and  7 mk  /.,  satisfies  the  following  nonlinear  algebraic  equation 


k—  1  k— 1 

E2'7mr,,/c_l_2  -L  2  \  ^  2/ym,  fc 

Vi-l  ~4  S™k,k  X,  V*~  l 

i=k—rrik  i=k—rrik 


Vi-i  =0’ 


where  s2rnk  k  and  k  denotes  the  local  moving  variance  of  Ay,  and  A  (yf)  respectively. 
To  solve  for  the  parameters  /?,  //  and  5,  we  define  the  conditional  moment  functions 

Fj  =  Fj  (E  [Ayj|Jy_i]  ,  E  [A(yi)2|Jr-_1]  ,E  [A(t/j)3| )  ,  j  =  1,2,3 


(6.48) 


(6.49) 


fc-1 

E  Vi—l 


Fi  =  i  £  E  [A^l-^*-!]  -  /3* 

i=k—mk 


k- 1 

E  2/i-i 

i=k—mu 


F2  =  ,_E  [e  [A(2/2)|^;_1]  -  E  [(Ay*  -  E  [Ay.,| Jy-i])2  |^_r]]  -  S 


fc-1 

E  K?_! 

=k  —  mu 


i=k—mk  L 

E1  2/S 

i=k  —  mu 


ft  =  [lE  [A<»?)lft-i]  -  4 


E  2/-_l 


Ed 

Vi 

i=k—mj. 


i=k—mk 


Using  (6.47),  we  have 


(6.50) 


F1  =  0 

<  F2  =  0  (6.51) 

F-z  =  0 

Let  F  =  { /•)  .  F-> ,  Fs } .  The  determinant  of  the  Jacobian  matrix  of  F  is  given  by 

/  k—  1  fc— 1  fc— 1  \ 

£  Jfc-i  £  vL i  £  (inyt-Oyf-r 

i=k—mk  i=k—mk  i=k—mk 

JF(/3,  y,  6)  =  det  E  yti  E  y5i-i  E  (lnr/i-i)^1  /0  (6.52) 

k  i=k—mk  i=k—mk  i=k—mk 

k—  1  k—1  k— 1 

E  i,  E  A  E  (inB-.yfc2 


\i=k—rrik  i=k—rrik 


i=k—rrik 
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provided  <5/1  and  the  sequence  {y(U- i)}iZk_mk 's  neither  zero  nor  a  constant.  We  want  to  avoid 
the  case  where  <5  =  1  because  this  will  change  the  structure  of  (6.42).  Thus,  by  the  application 
of  Theorem  6.1  (Implicit  Function  Theorem),  we  conclude  that  for  every  non-constant  m/.-local 
sequence  ,  <5/1,  there  exist  a  solution  of  system  of  algebraic  equations  (6.51) 

Prnk,k>  timk,k  as  a  point  estimates  of  B  and  //.  and  <5  respectively. 

The  solution  of  (6.51)  is  given  by 


< 


^  E1  Ayi  E1 

^  i=k  —  mj€  i=k—mjt 

—  E1  A  (y2)-s2  fc 

mr,  '  mu  ,k 

K  i=k  —  m^ 

k-1 

E  y»-i 

i=k  —  mjt 

1 

mfc 

k— 1  5  i  fc  — 1 

r— \  TTlu,k 

E  j/i_i  E  v 

i=k  —  rri]i  i=k  —  mjc 

k- 1  l+5m  k,k  k~1 

7-1-  E  Vi—1  E  Vi—l 

i=k  —  mfc  i=k  —  mfc 

fc  — 1  k— 1  S  i 

Ea  ~  V — A  ITlu  ,fc 

^yi~fJ'iri]t,k  zZ  Vi—  1 

i=k  —  mjc  i=k  —  mji 


k- 1 

E  3/i-l 

i=k  —  mjc 


where  5mkjk  satisfies  the  third  equation  in  (6.47)  described  by 


(6.53) 


1 

3  mk 


k- 1 

E 

i=k—mk 


Afe?) 


®mk,k 

mk 


k- 1 

E27mfe,fc  +  1 
i=k—rrik 


P 


k- 1 

E 

i=k—mk 


Vi-1 


mk 


k- 1 

E  t£i2 

i=k-mk 

n - =  0 

mk 


(6.54) 
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Chapter  7 

Computational  and  Simulation  Algorithms 


7.1  Introduction 

In  this  chapter,  we  outline  computational,  data  organizational  and  simulation  schemes.  We  intro¬ 
duce  the  ideas  of  iterative  data  process  and  data  simulation  time  schedules  in  relation  with  the  real 
time  data  observation/collection  schedule.  For  the  computational  estimation  of  continuous  time 
stochastic  dynamic  system  state  and  parameters,  it  is  essential  to  identify  an  admissible  set  of  local 
conditional  sample  average  and  sample  variance  parameters,  namely,  the  size  of  local  conditional 
sample  in  the  context  of  a  partition  of  time  interval  [— r,  T\.  Moreover,  the  discrete  time  dynamic 
model  of  conditional  sample  mean  and  sample  variance  statistics  processes  in  Section  6.2  and  the 
theoretical  parameter  estimation  scheme  in  Section  6.3  motivates  to  outline  a  computational  scheme 
in  a  systematic  and  coherent  manner.  A  brief  conceptual  computational  scheme  and  simulation  pro¬ 
cess  summary  is  described  below: 

7.2  Coordination  of  Data  Observation,  Iterative  Process,  and  Simulation  Schedules: 

Without  loss  of  generality,  we  assume  that  the  real  data  observation/collection  partition  schedule  P 
is  defined  in  (6.2).  Now,  we  present  definitions  of  iterative  process  and  simulation  time  schedule. 

DEFINITION  7.2. 1  The  iterative  process  time  schedule  in  relation  with  the  real  data  collection 
schedule  is  defined  by 

IP  =  {F~rti-.  for  UeP},  (7.1) 

where  F~rti  =  U-r,  and  F~r  is  a  forward  shift  operator  [11]. 

The  simulation  time  is  based  on  the  order  p  of  the  time  series  model  of  m^-local  conditional 
sample  mean  and  variance  processes  in  Lemma  6.1. 
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DEFINITION  7.2.2  The  simulation  process  time  schedule  in  relation  with  the  real  data  observation 
schedule  is  defined  by 

SP  =  (  { Frti  :  for  k  if  p  ~  r  (7  2) 

\  {Fpti  :  for  ti€  P},  if  p  >  r. 

Remark  20  We  note  that  the  initial  times  of  iterative  and  simulation  processes  arc  equal  to  the  real 
data  times  tr  and  tp,  respectively.  Moreover,  iterative  and  simulation  processes  time  in  (7.1)  and 
(7.2),  respectively  justify  Remark  17.  In  short,  t,  is  the  scheduled  time  clock  for  the  collection  of  the 
7th  observation  of  the  state  of  the  system  under  investigation.  The  iterative  process  and  simulation 
process  times  arc  tl+r  and  tt+p,  respectively. 


7.3  Conceptual  Computational  Parameter  Estimation  Scheme 


For  the  conceptual  computational  dynamic  system  parameter  estimation,  we  need  to  introduce  a 
few  concepts  of  local  admissible  sample/data  observation  size,  rrik- local  admissible  conditional 
finite  sequence  at  tk  £  SP,  local  finite  sequence  of  parameter  estimates  at  tk- 


Definition  7.3.1  For  each  k  £  7(0,  N ),  we  define  local  admissible  sample/data  observation  size 
rrik  at  tk  as  rrik  £  OSk,  where 


OSk 


I(2,r  +  k—  1),  if  p  <  r, 
7(2, p  +  k  -  1),  ifp  >  r, 


(7.3) 


Moreover,  0,5).  is  referred  as  the  local  admissible  set  of  lagged  sample/data  observation  size  at  tk- 


Definition  7.3.2  For  each  admissible  rrik  F  OSk  hi  Definition  7.3.1,  a  m-k-local  admissible 
lagged-adapted  finite  restriction  sequence  of  conditional  sample/data  observation  at  tk  to  subpar¬ 
tition  Pk  of  P  in  Definition  6.2.3  is  defined  by  {E[j/j| •  Moreover,  a  rrik-  class  of 
admissible  lagged-adapted  finite  sequences  of  conditional  sample/data  observation  of  size  m-k  at  tk 
is  defined  by 

ASk  =  }}-Zk-mk  ■■  mk  £  OSk}  =  myi\^i-i}}tk-mk}mkeOSk.  (7.4) 

In  the  case  of  energy  commodity  model,  for  each  rrik  F  O.S'/.,  we  find  corresponding  rrik-  local  ad¬ 
missible  adapted  finite  sequence  of  conditional  sample/data  observation  at  tk,  {E[yj|.Fj_i]}£z)!_  . 
Using  this  sequence  and  (6.40),  we  compute  amkp  Umk,k  and  k.  This  leads  to  a  local  finite  se¬ 
quence  of  parameter  estimates  at  tk  defined  on  OSk  as  follows:  \  ( am  ki  Tmk  k,  k)  >  = 

1  ’  ’  k)  >  mk£OSk 
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\  \r-\-k—l 
, k)  J  m/cE2 


Or  {  (5-mfc  ,k  5  Arrifc  ^ 


2 

mk 


,*)} 


p+k—  1 
mk£2  ■ 


It  is  denoted  by  (Ak,Mk,  Sk)=  j  (amktk,  fimk}k,  bfnfe  } 


mkeOSk 


7.4  Conceptual  Computation  of  State  Simulation  Scheme 


For  the  development  of  a  conceptual  computational  scheme,  we  need  to  employ  the  method  of 
induction.  The  presented  simulation  scheme  is  based  on  the  idea  of  lagged  adaptive  expectation 
process  [88].  An  autocorrelation  function  (ACF)  analysis  [11,  14]  performed  on  s2mk  k  suggests 
that  the  interconnected  discrete  time  dynamic  model  of  local  conditional  sample  mean  and  sample 
variance  statistics  in  (6.8)  is  of  order  p  =  2.  In  view  of  this,  we  need  to  identify  the  initial  data. 

We  begin  with  a  given  initial  data  yto,  {C0:0}m0eO.S’0>  {^iLi  -  Jm-ieOS-i,  {£m_li-1}m_1eOS_i- 
Let  ykni  k  be  a  simulated  value  of  K[yk\ lFk-i]  at  time  tk  corresponding  to  an  admissible  sequence 
{E[yj|7rj_i]}^Tfc1_mfc  G  ASk.  This  simulated  value  is  derived  from  the  discretized  Euler  scheme 
(6.26)  by 

Vmk,k  1  ~^~^mk-i,k—l  (fimk_i,k—l  Vmk_i,k—  l)ymk_i,k~  l^^^~^mk_i,k—iymk_1  k_\  IS.Wmkk. 

(7.5) 

Let  { ykni  k}mkeosk  be  a  mk-  local  sequence  of  simulated  values  corresponding  to  m/,. -admissible 
lagged  adapted  finite  sequence  of  conditional  observation  belonging  to  ASk  and  corresponding 
term  of  sequence  (Ak,  M&,  Sk).  Thus,  {yf  k}mk£OSk  is  the  finite  sequence  corresponding  to  finite 
simulated  values  of  IE |  l ]  at  tk. 


7.5  Mean-Square  Sub-Optimal  Procedure 

To  find  the  the  best  estimate  of  using  a  local  admissible  finite  sequence  k}mk£OSk 

of  simulation  of  {E[yj|  we  need  to  compute  a  finite  sequence  of  quadratic  mean  square  error 

corresponding  to  {yf  k}mkeOSk  •  The  quadratic  mean  square  eiror  is  defined  below. 

DEFINITION  7.5. 1  The  quadratic  mean  square  error  ofK[yk\J-k_ \  relative  to  each  member  of  the 
term  of  local  admissible  sequence  {ysmk  k}mkeOSk  of  simulated  values  is  defined  by 

“ mk,k,yk  =  (E[l/fc|-Tfc-l]  —  Vmk,k )  •  (7-6) 

For  any  arbitrary  small  positive  number  e  and  for  each  time  tk,  to  find  the  the  best  estimate  from 
the  admissible  simulated  values  of  simulated  sequence  of  {ysmk  k}mk£OSk  for  ^[yk\IFk-  | ],  we  de- 
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termine  the  following  sub-optimal  admissible  set  of  ////..-size  local  conditional  sample 

{j^k  •  " Jmk,k,yk  ^  ^  f^n  ?7i.fc  ^  OS fc}.  (7-7) 

Among  these  collected  values,  the  value  that  gives  the  minimum  Smfcifei2/fc  is  recorded  as  .  If 
more  than  one  value  of  rn^  exists,  then  the  largest  of  such  m/7s  is  recorded  as  rip,.  If  condition 
(7.7)  is  not  met  at  time  tb,  the  value  of  rrii-  where  the  minimum  min  Em,  /,  is  attained,  is  recorded 

mk  ,y 

as  m/..  The  e—  level  sub-optimal  estimates  of  the  parameters  finikj-  and  at  rh/,.  are 

also  recorded  as  a^^.,  Ihnk.k  and  cr2^  fc,  respectively.  Finally,  the  simulated  value  yklii  k  at  time 
tk  with  rhk  is  now  recorded  as  the  best  estimate  for  E[y/.|J7,:_  i  ]  at  tk .  This  value  is  called  the  e— 
sub-optimal  simulated  value  yktli  k  of  E[yy| Fk-i]  at  7 /,■ .  Similar  reasoning  can  be  provided  for  the 
estimates  of  the  parameters  of  the  U.S.  Treasury  Bill  Yield  Interest  Rate  and  U.  S.  Eurocurrency 
Exchange  Rate  model.  A  detailed  flowchart  of  the  conceptual  algorithm  is  as  follows: 


Flowchart  1 :  LLGMM  Conceptual  Computational  Algorithm. 


Moreover,  a  detailed  simulation  algorithm  is  presented  in  (S'.  4 

7.6  Applications:  Four  Energy  Commodity  Data  Sets 

Now,  we  apply  the  above  conceptual  computational  algorithm  for  the  real  time  data  sets  namely 
daily  Henry  Hub  Natural  gas  data  set  for  the  period  01/04/2000-09/30/2004,  daily  crude  oil  data 
set  for  the  period  01/07/1997  —  06/02/2008,  daily  coal  data  set  for  the  period  of  01/03/2000  — 
10/25/2013,  and  weekly  ethanol  data  set  for  the  period  of  03/24/2005  —  09/26/2013,  [22,  24,  23, 
136].  Using  At  =  1,  e  =  0.001,  r  =  5,  andp  =  2,  the  e—  level  sub-optimal  estimates  of  parameters 
a,  //  and  cr2  at  each  real  data  times  are  exhibited  in  Table  6. 
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Table  6:  Estimates  rhk,  cr^  fe,  ^mk,k  and  aAfe,fc 


tk 

Natural  gas 

tk 

Crude  oil 

tk 

Coal 

tk 

Ethanol 

rhk 

2 

CTmfc,fc 

Mrrifc,fc 

drhk,k 

rhk 

<Tnik,k 

[J“nik,k 

amk,k 

rhk 

2 

c'rhk,k 

dmk,k 

rhk 

2 

(Trhk,k 

fr"ihk,k 

CLrhk,k 

5 

3 

0.0001 

2.2231 

0.6011 

5 

3 

0.0001 

24.4100 

0.0321 

5 

3 

0.0001 

11.5534 

0.0142 

5 

2 

0.0002 

1.1767 

0.5831 

6 

3 

0.0002 

2.2160 

0.6122 

6 

3 

0.0002 

24.7165 

0.0341 

6 

3 

0.0000 

11.2529 

0.4109 

6 

5 

0.0008 

1.1717 

0.5159 

7 

3 

0.0002 

2.2513 

0.6087 

7 

4 

0.0003 

25.5946 

0.0537 

7 

3 

0.0001 

9.9161 

0.0165 

7 

4 

0.0007 

1.1707 

1.4925 

8 

4 

0.0002 

2.2494 

0.1628 

8 

5 

0.0006 

25.5550 

0.0467 

8 

3 

0.0002 

11.4663 

-0.0403 

8 

5 

0.0008 

1.1713 

1.4791 

9 

4 

0.0002 

2.2658 

-0.1497 

9 

4 

0.0006 

25.5695 

0.0499 

9 

3 

0.0005 

10.5922 

-0.0843 

9 

5 

0.0006 

1.1709 

2.1406 

10 

4 

0.0003 

2.1371 

0.1968 

10 

4 

0.0004 

25.4787 

0.0221 

10 

4 

0.0009 

8.9379 

0.0714 

10 

4 

0.0004 

1.1900 

0.8621 

11 

4 

0.0004 

2.5071 

-0.2781 

11 

3 

0.0001 

25.7742 

0.0100 

11 

4 

0.0023 

8.9051 

0.1784 

11 

3 

0.0025 

1.1900 

0.3719 

12 

4 

0.0000 

2.2550 

0.3545 

12 

3 

0.0002 

26.9477 

-0.0157 

12 

3 

0.0015 

9.0169 

0.0855 

12 

3 

0.0004 

1.2188 

0.5368 

13 

4 

0.0005 

2.5122 

0.6246 

13 

3 

0.0001 

25.8786 

-0.0112 

13 

3 

0.0020 

8.6231 

0.0739 

13 

5 

0.0004 

1.1120 

12.2917 

14 

4 

0.0015 

2.4850 

0.5604 

14 

5 

0.0005 

22.1834 

0.0049 

14 

2 

0.0001 

10.0100 

0.0564 

14 

5 

0.0007 

1.1669 

-0.9289 

15 

3 

0.0007 

2.5378 

0.4846 

15 

5 

0.0004 

23.5425 

0.0010 

15 

5 

0.0067 

9.5281 

0.0741 

15 

5 

0.0014 

0.7492 

-0.0879 

16 

3 

0.0007 

2.5715 

0.7737 

16 

4 

0.0002 

23.8500 

0.0000 

16 

4 

0.0058 

6.1821 

0.0694 

16 

5 

0.0011 

1.7968 

0.3087 

17 

5 

0.0011 

2.5688 

0.5984 

17 

4 

0.0002 

23.8486 

0.0502 

17 

4 

0.0015 

8.8087 

0.0404 

17 

5 

0.0002 

1.8484 

-0.1901 

18 

4 

0.0010 

2.5831 

0.5423 

18 

5 

0.0004 

23.2913 

-0.0113 

18 

4 

0.0035 

9.0681 

0.0652 

18 

5 

0.0003 

1.1650 

-0.1611 

19 

5 

0.0007 

2.5893 

0.4256 

19 

3 

0.0000 

24.4715 

0.1282 

19 

3 

0.0040 

9.0752 

0.1527 

19 

5 

0.0022 

1.8943 

0.1502 

20 

5 

0.0006 

2.6100 

0.0683 

20 

3 

0.0004 

24.3878 

0.0415 

20 

3 

0.0049 

9.0801 

0.1405 

20 

5 

0.0047 

1.8144 

0.2073 

781 

3 

0.0001 

6.2830 

0.0307 

2446 

4 

0.0001 

59.6591 

0.0012 

2871 

5 

0.0008 

26.9028 

0.0131 

281 

3 

0.0003 

1.6026 

-1.8731 

782 

4 

0.0004 

5.6052 

0.0450 

2447 

5 

0.0007 

59.5048 

0.0059 

2872 

5 

0.0008 

26.7876 

0.0158 

282 

5 

0.0007 

1.7479 

0.2390 

783 

4 

0.0009 

5.9775 

0.0996 

2448 

4 

0.0005 

58.9636 

0.0050 

2873 

4 

0.0003 

26.6849 

-0.0313 

283 

4 

0.0010 

3.7451 

0.0171 

784 

4 

0.0230 

13.6910 

0.3781 

2449 

5 

0.0004 

58.4700 

0.0042 

2874 

5 

0.0008 

25.7722 

0.0231 

284 

5 

0.0008 

1.9909 

0.0267 

785 

5 

0.0189 

9.7555 

-0.1031 

2450 

4 

0.0002 

58.5012 

0.0071 

2875 

4 

0.0009 

25.5993 

0.0253 

285 

5 

0.0005 

1.8650 

0.5265 

786 

5 

0.0213 

9.2861 

0.0550 

2451 

4 

0.0003 

59.2442 

0.0048 

2876 

5 

0.0007 

25.6284 

0.0544 

286 

5 

0.0016 

1.8887 

1.1808 

787 

5 

0.0149 

9.2482 

0.0501 

2452 

4 

0.0003 

59.0349 

-0.0  015 

2877 

4 

0.0006 

25.2403 

0.0364 

287 

5 

0.0014 

1.2920 

0.1535 

788 

5 

0.0083 

9.1330 

0.0985 

2453 

5 

0.0004 

59.2438 

0.0006 

2878 

5 

0.0009 

25.3519 

0.0301 

288 

5 

0.0006 

2.0086 

0.5159 

789 

5 

0.0161 

6.5570 

0.2080 

2454 

5 

0.0004 

60.1814 

0.0033 

2879 

4 

0.0005 

25.0336 

0.0528 

289 

4 

0.0042 

1.9985 

0.4236 

790 

5 

0.0114 

7.0045 

0.0989 

2455 

4 

0.0003 

59.9567 

0.0091 

2880 

5 

0.0006 

25.2560 

0.0963 

290 

4 

0.0030 

1.9857 

0.5156 

791 

5 

0.0071 

0.5917 

0.1034 

2456 

5 

0.0004 

59.6785 

0.0025 

2881 

4 

0.0003 

25.3842 

0.0438 

291 

4 

0.0023 

2.0219 

0.8551 

792 

5 

0.0096 

6.9603 

0.1118 

2457 

4 

0.0004 

58.7682 

0.0049 

2882 

3 

0.0006 

25.5547 

0.0552 

292 

5 

0.0030 

2.2320 

0.2054 

793 

5 

0.0045 

6.8894 

0.0341 

2458 

4 

0.0003 

58.4793 

0.0086 

2883 

3 

0.0005 

25.5867 

0.0719 

293 

4 

0.0009 

2.2062 

0.0655 

794 

5 

0.0056 

7.3016 

0.2594 

2459 

4 

0.0001 

57.9168 

0.0053 

2884 

5 

0.0008 

25.5035 

0.0649 

294 

3 

0.0009 

2.3554 

0.0893 

795 

5 

0.0049 

3.9781 

0.3501 

2460 

4 

0.0004 

56.1216 

0.0177 

2885 

3 

0.0004 

25.5128 

0.0690 

295 

3 

0.0018 

2.3115 

0.5336 

Table  6  shows  the  estimates  of  the  e-  sub-optimal  size  rhk,  the  parameters  k,  Prhk,k  and  cirhk,k  for  each  of  the 
energy  commodity  data  sets.  Moreover,  p  <  r,  and  the  initial  real  data  time  is  tr  =  £5. 

In  the  following,  the  graph  of  cimk,k  for  daily  natural  gas,  daily  crude  oil,  daily  coal,  and  weekly 
ethanol  are  exhibited  in  Figure  8  (a),  (b),  (c)  and  (d),  respectively. 
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Graph  of  am  k  against  tk  for  Natural  Gas 


Graph  of  am  k  against  tk  for  Crude  Oil 


Graph  of  am  k  against  tk  for  Ethanol 


Figure  8.:  The  graph  of  mean  reverting  rate  a,mk,k  with  time  f/c 


Figures  8:  (a),  (b),  (c)and  (d)  are  the  graphs  of  a,rhk,k  against  time  tk  for  the  daily  Henry  Hub  natural  gas  data  set 
[24]  ,  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22],  and  weekly  ethanol  data  set  [136],  respectively.  It  shows  the 
rate  at  which  the  data  sets  are  reverting  to  the  mean  level. 

Furthermore,  we  show  the  graphs  of  Hmk,k  for  each  of  the  data  set:  Natural  gas,  Crude  Oil,  Coal 
and  Ethanol  in  Figure  9  (a),  (b),  (c)  and  (d),  respectively. 


87 


Graph  of  k  against  tk  for  Natural  Gas 


Graph  of  k  against  tk  for  Coal 


Figure  9.:  The  graph  of  mean  level  Hmk,k  with  time  tk 


Figures  9:  (a),  (b),  (c)and  (d)  are  the  graphs  of  ymk,k  against  time  tk  for  the  daily  Henry  Hub  natural  gas  data  set 
[24],  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22],  and  weekly  ethanol  data  set  [136]  respectively.  The  sample 
means  of  the  real  data  yk  sets  for  Natural  gas,  Crude  oil  data  and  Coal  data  are  given  by  4.5385,  54.0093,  27.1441  and 
2.1391  respectively.  It  can  be  seen  from  Figure  9:  (a)  that  the  graph  of  Hmk,k  for  the  Henry  Hub  Natural  gas  data  set 
moves  around  the  mean  value  4.5385  of  the  real  data  set.  Also,  from  Figure  9:  (b),  the  values  of  for  the  crude  oil 
data  moves  around  the  mean  value  54.0093  of  the  crude  oil  data  set.  Likewise,  from  Figure  9:  (c),  the  values  of  tLmk,k 
for  the  coal  data  moves  around  the  mean  value  27.1441  of  the  coal  data  set.  Finally,  from  Figure  9:  (d),  the  values  of 
tifhk,k  for  the  ethanol  data  moves  around  the  mean  value  2.1391  of  the  ethanol  data  set.  This  analysis  shows  that  the 
parameter  is  close  to  the  respective  mean  of  the  data  set  at  time  tk- 

We  remark  that  {l.imij}]L()  and  {a,rhi,i}f=o  are  discrete-time  e—  sub-optimal  simulated  random 
samples  generated  by  the  scheme  described  at  the  beginning  of  Section  7.6. 
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Next,  we  show  the  graph  of  s^fc  k  for  each  of  the  data  set:  Natural  gas,  Crude  oil.  Coal  and 


Ethanol  in  Figures  10  (a),  (b),  (c)  and  (d),  respectively. 

Graph  of  k  against  tk  for  Natural  Gas 


Graph  of  s':  k  against  t  for  Crude  Oil 


Graph  of  s':  k  against  tk  for  Ethanol 


time  tk  (days) 

Figure  10.:  Moving  Variance  sjn/  k  against  k  for  three  commodities 


Figures  10:  (a),  (b),  (c)  and  (d)  are  graphs  of  against  time  tk  with  initial  delay  r  =  5  for  the  daily  Henry 

Hub  natural  gas  data  set  [24]  ,  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22],  and  weekly  ethanol  data  set  [136] 
respectively.  We  found  these  estimates  using  the  discrete  time  dynamic  model  (6.8)  with  p  =  2,  with  the  usage  of  p  =  2 
because  of  the  autocorrelation  and  partial  autocorrelation  function  of  the  series  x,  as  described  in  [80].  Using  the  third 
part  of  (6.53),  the  volatility  square  at  time  tk  can  be  calculated. 


The  overall  descriptive  statistics  of  data  sets  regarding  the  energy  commodity  prices  and  estimated 
parameters  are  recorded  in  the  Table  7. 
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Table  7:  Descriptive  Statistics  for  a,  \i  and  a2. 


Data  Set  Y 

Y 

Std(Y) 

A  ln(Y) 

var(A/n(T)) 

a 

Std(o) 

A 

Std(/i) 

3§ 

std(cr2) 

95%  C.  I.  p 

Nat.  Gas 

4.5504 

1.5090 

0.0008 

0.0015 

0.1867 

0.3013 

4.5538 

2.3565 

0.0013 

0.0017 

(4.4196,  4.6880) 

Crude  Oil 

54.0093 

31.0248 

0.0003 

0.0006 

0.0215 

0.0517 

54.0307 

37.4455 

0.0005 

0.0008 

(51.8978,  56.1636) 

Coal 

27.1441 

17.8394 

0.0003 

0.0015 

0.0464 

0.0879 

27.0567 

21.3506 

0.0014 

0.0022 

(25.8405,  28.2729) 

Ethanol 

2.1391 

0.4455 

0.0011 

0.0020 

0.3167 

0.8745 

2.1666 

0.7972 

0.0018 

0.0030 

(2.0919,2.2414) 

Table  7  shows  the  descriptive  statistics  for  a,  /i  and  a2  with  time  delay  r  =  5.  Note  that  the  mean  value  of  the  estimated 

N  N  _  N 

samples  {a^^fLo,  and  JjiLo  are  a  =  ±  A  =  ^  E  Ato*,*  and  c2  =  ^ 


i=0  i=0  i=0 

respectively,  a,  /i,  and  a2  are  referred  to  as  aggregated  parameter  estimates  of  a,  p,  and  a2  over  the  given  entire  finite 
interval  of  time,  respectively,  p  is  the  descriptive  statistics  of  the  parameter  p  estimated  in  column  8,  while  cr2  is  the 
descriptive  statistics  of  the  parameter  a2  estimated  in  column  10.  Moreover,  p  is  approximately  close  to  the  overall 
descriptive  statistics  of  the  mean  Y  of  the  real  data  set  for  each  of  the  energy  commodities  shown  in  column  2.  Also,  a2 
is  approximately  close  to  the  overall  descriptive  statistics  of  the  variance  of  A  ln(Y)  =  ln(Yi)  —  ln(Yi-i)  in  Column  5. 
Moreover,  column  12  shows  that  the  mean  of  the  actual  data  set  in  Column  2  falls  within  the  95%  confidence  interval  of 
p.  This  exhibits  that  the  parameter  Pmk,k  is  the  mean  level  of  yk  at  time  tk- 


We  have  used  the  the  estimated  parameters  arnh,k,  and  <r^fc  k,  in  Figures  8,  9,  and  10, 

respectively  to  simulate  the  daily  natural  gas  data  set,  daily  crude  oil  data  set,  daily  coal  data  set, 
and  weekly  ethanol  data  set. 

In  fact,  developing  the  code  and  flowchart  described  in  CA  and  the  parameters  described  in 
Figures  8,  9  and  10,  we  simulate  the  daily  Natural  Gas  data  set,  daily  Crude  Oil  data  set,  the  daily 
Coal  data  set  and  weekly  ethanol  data  set. 

For  this  purpose,  we  pick  e  =  0.01;  for  each  time  tk,  the  estimates  of  the  simulated  prices  k 
are  computed  by  determining  the  sub-optimal  admissible  set  of  mk- size  local  conditional  sample 
Mk  defined  in  (7.7).  Among  these  collected  values,  the  value  that  gives  the  minimum  Emfc  ^  j,fc 
is  recorded  as  rh/..  If  condition  (7.7)  is  not  met  at  time  tk,  the  value  of  mk  where  the  minimum 

minEmfcjfcjJ/fc  is  attained,  is  recorded  as  rhk ■  The  e—  level  sub-optimal  estimates  of  the  parameters 

mk 

amk,k,  Prnk,k  and  cr2m^k  at  mk  are  also  recorded  as  a^k,  prhk,k  and  cr^fejfc,  the  value  of  ysmk  k  at 

time  tk  and  rhk  corresponding  to  drhk,k,  and  rr2n^  k  is  also  recorded  as  the  e—  sub-optimal 

simulated  value  ykni  k  as  an  estimate  of  ijk.  A  detailed  algorithm  is  given  in  Appendix  C.4. 

Finally,  in  Table  8,  we  show  the  results  of  the  real,  simulated  prices  using  the  local  lagged  adapted 
generalized  method  of  moment  (LLGMM)  and  the  simulated  price  using  the  aggregated  parameter 
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estimates  a,  //,  and  a 2  in  Table  7,  Column  6,  8,  and  10,  respectively  for  the  energy  commodity  price. 
This  estimate  is  derived  using  the  discretized  model 

Vi9  =  yt-i  +  aQi  -  yT-^vT- iAt  +  (7.8) 

For  the  rest  of  this  study,  we  define  this  estimate  at  time  t\~  by  the  aggregated  GMM  simulated 
estimates  (AGMM). 

Table  8:  Real,  Simulation  using  LLGMM  prices,  and  Simulation  using  AGMM. 


tk 

Natural  gas 

tk 

Crude  oil 

tk 

Coal 

tk 

Ethanol 

Real 

Simulated 

(LLGMM) 

Simulated 

Vk 

(AGMM) 

Real 

Simulated 

(LLGMM) 

Simulated 

yl9 

(AGMM) 

Real 

Simulated 

(LLGMM) 

Simulated 

ylg 

(AGMM) 

Real 

Simulated 

(LLGMM) 

Simulated 

yl9 

(AGMM) 

5 

2.216 

2.216 

2.216 

5 

25.200 

25.200 

25.000 

5 

10.560 

10.560 

10.000 

5 

1.190 

1.190 

1.000 

6 

2.260 

2.253 

2.276 

6 

25.100 

25.077 

25.501 

6 

10.240 

10.436 

10.150 

6 

1.150 

1.174 

1.233 

7 

2.244 

2.241 

2.255 

7 

25.950 

25.606 

25.612 

7 

10.180 

10.325 

10.555 

7 

1.180 

1.180 

1.321 

8 

2.252 

2.249 

2.255 

8 

25.450 

25.494 

26.011 

8 

9.560 

10.072 

10.160 

8 

1.160 

1.148 

1.277 

9 

2.322 

2.329 

2.291 

9 

25.400 

25.411 

26.038 

9 

8.750 

8.338 

10.610 

9 

1.190 

1.196 

1.318 

10 

2.383 

2.376 

2.362 

10 

25.100 

24.981 

25.099 

10 

9.060 

9.072 

10.936 

10 

1.190 

1.209 

1.395 

11 

2.417 

2.417 

2.201 

11 

24.800 

24.763 

25.715 

11 

8.880 

9.084 

10.624 

11 

1.225 

1.186 

1.398 

12 

2.559 

2.534 

2.182 

12 

24.400 

24.301 

25.670 

12 

9.440 

9.581 

10.174 

12 

1.220 

1.217 

1.473 

13 

2.485 

2.554 

2.022 

13 

23.850 

24.862 

26.176 

13 

10.310 

9.739 

9.807 

13 

1.290 

1.250 

1.489 

14 

2.528 

2.525 

2.016 

14 

23.850 

23.961 

26.142 

14 

9.810 

9.633 

9.548 

14 

1.410 

1.320 

1.459 

15 

2.616 

2.615 

2.057 

15 

23.850 

24.010 

26.602 

15 

9.060 

9.197 

9.904 

15 

1.470 

1.392 

1.451 

16 

2.523 

2.478 

2.122 

16 

23.900 

24.071 

26.094 

16 

8.750 

8.806 

9.888 

16 

1.530 

1.461 

1.378 

17 

2.610 

2.638 

2.181 

17 

24.500 

24.554 

26.051 

17 

8.820 

8.879 

9.878 

17 

1.630 

1.545 

1.275 

18 

2.610 

2.606 

2.265 

18 

24.800 

24.795 

25.973 

18 

9.560 

9.326 

10.095 

18 

1.750 

1.7433 

1.284 

19 

2.610 

2.614 

2.356 

19 

24.150 

24.165 

26.385 

19 

8.820 

8.749 

10.158 

19 

1.750 

1.858 

1.189 

20 

2.699 

2.726 

2.430 

20 

24.200 

23.971 

25.817 

20 

8.820 

8.774 

10.180 

20 

1.840 

1.886 

1.224 

1145 

5.712 

5.709 

5.356 

2440 

57.350 

57.298 

64.878 

2865 

29.310 

29.065 

28.288 

375 

2.073 

2.019 

2.068 

1146 

5.588 

5.592 

5.464 

2441 

56.740 

56.650 

64.333 

2866 

28.680 

28.619 

26.839 

376 

2.020 

2.003 

1.948 

1147 

5.693 

5.650 

5.610 

2442 

57.550 

57.613 

64.350 

2867 

26.770 

28.408 

26.448 

377 

2.073 

2.094 

1.868 

1148 

5.791 

5.786 

5.489 

2443 

59.090 

59.152 

64.319 

2868 

27.450 

27.480 

26.555 

378 

2.065 

2.076 

1.898 

1149 

5.614 

5.458 

5.682 

2444 

60.270 

58.926 

65.331 

2869 

27.000 

27.250 

27.808 

379 

2.055 

2.061 

1.803 

1150 

5.442 

5.460 

6.047 

2445 

60.750 

59.675 

64.43 

2870 

26.670 

26.544 

26.804 

380 

2.209 

2.169 

1.869 

1151 

5.533 

5.571 

6.192 

2446 

58.410 

59.408 

66.356 

2871 

26.510 

26.497 

27.429 

381 

2.440 

2.208 

1.764 

1152 

5.378 

5.397 

6.251 

2447 

58.720 

58.917 

65.789 

2872 

26.480 

26.463 

28.481 

382 

2.517 

2.220 

1.687 

1153 

5.373 

5.374 

6.085 

2448 

58.640 

58.502 

61.865 

2873 

25.150 

25.781 

29.022 

383 

2.718 

2.362 

1.744 

1154 

5.382 

5.420 

5.901 

2449 

57.870 

58.721 

64.171 

2874 

25.570 

25.615 

28.829 

384 

2.541 

2.687 

1.716 

1155 

5.507 

5.501 

5.986 

2450 

59.130 

58.985 

64.001 

2875 

25.880 

25.948 

29.549 

385 

2.566 

2.607 

1.785 

1156 

5.552 

5.551 

5.632 

2451 

60.110 

60.087 

64.234 

2876 

25.240 

25.451 

29.080 

386 

2.626 

2.549 

1.716 

1157 

5.310 

5.272 

5.525 

2452 

58.940 

58.858 

64.419 

2877 

25.000 

24.649 

29.392 

387 

2.587 

2.606 

1.816 

1158 

5.338 

5.348 

5.183 

2453 

59.930 

59.390 

62.080 

2878 

25.080 

24.984 

28.834 

388 

2.628 

2.624 

1.761 

1159 

5.298 

5.353 

5.024 

2454 

61.180 

60.283 

59.690 

2879 

25.050 

25.158 

29.122 

389 

2.587 

2.556 

1.909 

1160 

5.189 

5.207 

5.025 

2455 

59.660 

59.939 

60.680 

2880 

25.890 

25.835 

31.099 

390 

2.536 

2.546 

1.969 

Next,  we  show  the  graph  of  the  simulated  data  set  using  the  LLGMM  method  for  each  of  the 
commodities  in  Figure  11. 
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Real  and  Simulated  Spot  Price  for  Natural  Gas  Real  Spot  Price  and  Simulated  Spot  Price  for  Crude  Oil 


Real  Spot  Price  and  Simulated  Spot  Price  for  Coal  Real  and  Simulated  price  for  Ethanol 


Figure  11.:  Real  and  Simulated  Prices:  r  =  5. 


Figures  11:  (a),  (b),  (c)  and  (d)  show  the  graph  of  the  Real  and  Simulated  Spot  Prices  for  the  daily  Henry  Hub  natural 
gas  data  set  [24]  ,  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22],  and  weekly  ethanol  data  set  [136]  respectively. 
The  red  line  represents  the  real  data  set  y^,  while  the  blue  line  represent  the  simulated  data  set  fc.  The  root  mean 
square  error  of  the  simulation  for  the  Henry  Hub  Natural  gas  data  set,  the  Crude  Oil  data  set,  the  Coal  and  Ethanol  data 
set  are  given  by  0.021,  0.013,  0.015,  and  0.046  respectively.  Here,  we  begin  by  using  a  starting  delay  of  r  =  5.  The 
simulation  starts  from  tr  —  t$.  It  is  clear  that  the  graph  fits  well,  but  there  are  still  some  regions  where  the  simulation 
does  not  capture  the  real  data  well.  Therefore,  this  gap  is  analyzed  by  increasing  the  magnitude  of  time  delay. 

The  following  graphs  show  the  Real  and  Simulated  Spot  Prices  for  the  daily  Henry  Hub  natural 
gas  data  set  [24]  ,  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22],  and  weekly  ethanol  data  set 
[136],  respectively,  for  the  case  where  r  =  10. 
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Real  Spot  Price  S(t)  and  Simulated  Spot  Price  y(t)  for  Natural  Gas  Real  Spot  Price  S(t)  and  Simulated  Spot  Price  y(t)  for  Crude  Oil 


Real  Spot  Price  S(t)  and  Simulated  Spot  Price  y(t)  for  Coal  Real  and  Simulated  price  for  Ethanol 


Figure  12.:  Real  and  Simulated  Prices:  r  =  10. 


Figures  12:  (a),  (b),  (c)  and  (d)  show  the  graph  of  the  Real  and  Simulated  Spot  Prices  for  the  daily  Henry  Hub  Natural 
gas  data  set  [24]  ,  daily  Crude  Oil  data  set  [23],  daily  Coal  data  set  [22],  and  weekly  ethanol  data  set  [136],  respectively, 
for  r  =  10.  The  red  line  represents  the  real  data  set  y k  while  the  blue  line  represent  the  simulated  data  set  y%,kik-  The 
root  mean  square  error  of  the  simulation  for  the  Henry  Hub  Natural  gas  data  set,  the  Crude  Oil  data  set,  the  Coal  data  set, 
and  ethanol  data  set  are  given  by  0.004,  0.001,  0.002  and  0.006,  respectively. 

Remark  21  Several  other  delays  were  tested  and  it  was  found  that  as  the  delay  r  increases,  the 
root  mean  square  error  decreases,  significantly.  Moreover,  the  curve  fitting  appears  to  be  better.  For 
example,  for  starting  delay  of  20,  the  root  mean  square  error  of  the  simulation  for  the  Henry  Hub 
natural  gas  data  set,  the  crude  oil  data  set,  coal  data  set  and  ethanol  data  set  are  given  by  2  x  HF  , 
10-5,  IQ  4,  and  5  x  10-4,  respectively.  Furthermore,  the  simulation  results  show  that  the  price  of  a 
commodity  is  affected  by  its  volatility  cr^  k,  the  rate  and  mean  level  parameters  cimk,k  and  Hmk,k’ 
respectively. 
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In  Figure  13,  we  show  a  comparison  between  the  real  data  set,  simulated  price  using  the  local 
lagged  adaptive  generalized  method  (LLGMM)  and  the  simulated  price  (AGMM)  using  the  aggre¬ 
gated  parameter  estimates  a,  £L,  and  a2  in  Table  7,  Column  6,  8,  and  10,  respectively. 


Real,  Simulated  LLGMS,  Simulated  for  Natural  Gas 


Real,  Simulated  LLGMS,  Simulated  for  Crude  Oil 


Real,  Simulated  LLGMS,  Simulated  for  Coal 


Real,  Simulated  LLGMS,  Simulated  for  Ethanol 


Figure  13.:  Real,  Simulated  Prices  using  (LLGMM),  and  Simulated  Prices  using  AGMM. 


Figures  13:  (a),  (b),  (c)  and  (d)  show  the  graph  of  the  Real,  simulated  prices  using  the  local  lagged  adaptive  general¬ 
ized  method  (LLGMM),  and  the  simulated  price  using  the  average  of  the  parameters  for  Henry  Hub  Natural  gas  data  set 
[24]  ,  daily  Crude  Oil  data  set  [23],  daily  Coal  data  set  [22],  and  weekly  ethanol  data  set  [136],  respectively,  for  r  =  5. 
The  red  line  represents  the  real  data  set  yk,  the  blue  line  represent  the  simulated  prices  using  LLGMM  method,  while 
the  black  line  represent  the  simulated  price  (AGMM)  using  the  aggregated  parameter  estimates  a,  jX,  and  a2  in  Table  7, 
Column  6,  8,  and  10,  respectively.  From  these  simulated  graphs,  it  is  clear  that  the  LLGMM  simulation  results  are  more 
realistic  than  the  AGMM  simulation  results.  This  exhibits  the  power  of  LLGMM  over  the  AGMM. 

Remark  22  A  code  similar  to  the  flowchart  described  in  CA  is  designed  to  exhibit  the  flowchart 
algorithm.  All  the  codes  for  the  parameter  estimation,  simulations  and  forecasting  are  written  and 
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tested  using  Matlab  program.  Due  to  the  online  control  nature  of  rrik  in  our  model,  it  is  worth 
mentioning  that  the  running  times  for  each  of  the  four  commodities:  Natural  gas.  Crude  oil,  Coal 
and  Ethanol  depend  on  the  robustness  of  the  data.  The  average  running  time  for  each  data  set  is  25 
minutes. 

In  reference  to  Remark  16,  we  compare  the  estimates  sfhf  k  with  the  estimate  derived  from  the 
usage  of  a  GARCH(1,1)  model  described  in  [9]  which  is  defined  by 

zt\Ft-i  ~  N(0,ht), 

ht  =  cto  +  oi\ht—\  +  «o  >  0,  cm,  (5\  >  0. 

The  parameters  a0,  a \ ,  and  3]  of  the  GARCH(1,1)  conditional  variance  model  (7.9)  for 
the  four  commodities  natural  gas,  crude  oil,  coal,  and  ethanol  arc  estimated.  The  estimates 
parameters  arc  given  in  Table  9. 

Table  9:  Parameter  estimates  for  GARCH(1,1)  Model  (7.9). 


(7.9) 

x  for 
of  the 


Data  Set 

«o 

OL\ 

Pi 

Natural  Gas 

6.863  x  10"5 

0.853 

0.112 

Crude  Oil 

9.622  x  1CT5 

0.917 

0.069 

Coal 

3.023  x  10“5 

0.903 

0.081 

Ethanol 

4.152  x  10“4 

0.815 

0.019 

Table  9  shows  the  parameter  estimates  for  GARCH(1,1)  Model 

We  later  show  a  side  by  side  comparison  of  s~n/  k  and  the  volatility  described  by  GARCH(1,1) 
model  described  in  (7.9)  with  coefficients  in  Table  9. 
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k  and  Garch(1 ,1)  for  Natural  Gas 


s':  k  and  Garch(1 ,1)  for  Crude  Oil 


s':  k  and  Garch(1 ,1)  for  Ethanol 


time  tk  (days) 


Figure  14.:  sfn/  k  and  GARCH(1,1)  . 

Figures  14:  (a),  (b)  and  (c)  are  graphs  of  s\hk  and  GARCH(1,1)  model  against  time  tk  for  the  daily  Henry  Hub  nat¬ 
ural  gas  data  set  [24]  ,  daily  crude  oil  data  set  [23],  daily  coal  data  set  [22]  and  weekly  ethanol  data  set  [136]  respectively. 
The  blue  line  shows  the  graph  of  estimates  for  s\  k  and  the  red  line  shows  the  graph  of  estimates  for  GARCH(1,1) 
model.  The  GARCH  model  does  not  clearly  estimate  volatility  as  heavily  evidenced  in  Figure  14  (d).  In  fact,  it  de- 
mostrated  insensitivity.  The  presented  analysis  suggests  that  the  GARCH  model  is  ineffective  in  comparison  with  the 
framework  of  moving  average  process. 

We  also  compare  the  simulations  in  Figure  11  with  the  simulations  using  the  GARCH(1,1)  model 
(7.9)  as  the  conditional  variance.  The  following  figure  exhibits  the  comparison. 
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Real,  Simulation  using  s?,  .  and  Garch  for  Natural  Gas  Real,  Simulation  using  s':  and  Garch  for  Crude  Oil 

m  ,k  m  ,k 


Real,  Simulation  using  s^  k  and  Garch  for  Coal  Real,  Simulation  using  s^  k  and  Garch  for  Ethanol 


Figure  15.:  Simulation  derived  by  using  s k  and  GARCF1(1,1) 


Figures  15:  (a),  (b),  (c)  and  (d)  are  graphs  of  the  simulations  using  k  and  GARCH(l.l)  model  to  estimate  the 
volatility  process  for  the  daily  Henry  Hub  Natural  gas  data  set  [24] ,  daily  Crude  oil  data  set  [23],  daily  Coal  data  set  [22], 
and  weekly  Ethanol  data  set  [136],  respectively.  The  blue  line  shows  the  graph  of  estimates  for  the  simulations  using 
GARCH(1,1)  model  to  simulate  the  volatility,  the  green  line  is  our  simulated  estimates  described  in  Figure  11,  and  the 
red  line  shows  the  real  data  set.  It  can  be  seen  that  the  GARCH  model  fails  to  capture  most  of  the  spikes  in  the  data  set. 
Moreover,  the  GARCH  model  creates  significant  errors  by  over-and-under  estimating  the  variance.  These  spikes  were 
perfectly  captured  in  Figure  11  where  we  use  the  discrete-time  dynamic  model  of  local  sample  variance  statistics  process 
to  estimate  the  volatility  process.  This  illustrates  that  the  dynamic  statistic  model  works  better  than  the  GARCH  volatility 
model. 
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7.7  Applications:  U.  S.  Treasury  Bill  Yield  Interest  Rate  and  U.  S.  Eurocurrency  Exchange 
Rate  Data  Sets 

In  this  subsection,  we  apply  the  conceptual  computational  algorithm  discussed  above  to  estimate 
the  parameters  in  (6.42)  using  the  real  time  Treasury  bill  yield  data  sets  [128]  and  the  US  dollar 
Eurocurrency  data  set  [129]  collected  from  Forex  database. 

Table  10:  Estimates  rhk,  Prhk,k,  A* mk,k ,  $mk,k,  &mk,k,  7 mk,k  for  U.  S.  Treasury  Bill  Interest  Rate. 


tk 

Interest  Rate 

rhk 

0rnk,k 

f-^rnk,k 

^mk,k 

’Tm/ofc 

5 

2 

1.342 

6.1344 

1.23 

0.0650 

1.46 

6 

2 

-1.4536 

7.7969 

1.4600 

0.0740 

1.4963 

7 

3 

-1.9051 

15.5056 

1.4600 

0.0973 

1.4942 

8 

5 

0.3703 

-1.8563 

1.4600 

0.2681 

0.5218 

9 

5 

0.3209 

-1.46591 

1.4600 

0.2674 

1.1845 

10 

5 

0.8104 

-4.0798 

1.4600 

0.2605 

1.0916 

11 

4 

2.0471 

-10.3264 

1.4600 

0.0948 

1.4632 

12 

4 

2.2642 

-11.4387 

1.4600 

0.0692 

1.4335 

13 

3 

-3.5423 

17.8429 

1.4600 

0.0660 

1.4989 

14 

5 

0.7275 

-3.7090 

1.4600 

0.0734 

1.4835 

15 

5 

0.9500 

-4.8475 

0.0688 

1.4968 

16 

5 

1.8567 

-9.4523 

1.46000 

0.0836 

1.4998 

17 

5 

-0.0187 

0.1323 

1.46000 

0.1289 

1.4990 

18 

5 

-0.2657 

1.4233 

1.4600 

0.1148 

1.4168 

19 

4 

-1.6380 

-8.3661 

1.4600 

0.2017 

1.0316 

20 

4 

-0.3631 

-1.9923 

1.4600 

0.2236 

0.9800 

420 

5 

3.8416 

-18.3309 

1.4600 

0.1187 

1.4986 

421 

4 

2.0695 

-9.8104 

1.4600 

0.1594 

1.4906 

422 

4 

1.4882 

-7.0240 

1.4600 

0.1643 

1.2216 

423 

4 

1.1992 

-5.5523 

1.4600 

0.1899 

1.3399 

424 

4 

1.2800 

-5.9315 

1.4600 

0.1814 

1.4736 

425 

5 

0.4408 

-1.9812 

1.4600 

0.1901 

1.4961 

426 

5 

-0.5137 

2.4739 

1.4600 

0.1616 

1.4972 

427 

5 

0.0508 

-0.1078 

1.4600 

0.1547 

1.4994 

428 

5 

-0.0623 

0.3913 

1.4600 

0.1174 

1.4975 

429 

5 

0.1269 

-0.4112 

1.4600 

0.1175 

1.5050 

430 

5 

0.1828 

-0.661 1 

1.4600 

0.0856 

1.4983 

431 

5 

0.4780 

-1.9674 

1.4600 

0.0765 

0.1008 

432 

5 

0.5655 

-2.3219 

1.4600 

0.0719 

1.0406 

433 

5 

1.4002 

-5.8583 

1.4600 

0.0839 

1.3915 

434 

5 

1.9290 

-8.0357 

1.4600 

0.1145 

1.4369 

435 

4 

0.6095 

-2.4585 

1.4600 

0.2260 

1.2307 
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Table  11:  Estimates  mk,  Bm^k,  Hmk,k,  &mhlk,  °mk,k,  lmk.k  for  U.S.  Eurocurrency  Exchange  Rate. 


US  Eurocurrency  Exchange  Rate 


0mk,k 


Ornk,k  &mk,k  ~frri  .A: 


5  1 

6  2 

7  2 

8  2 

9  4 

10  2 

11  5 

12  4 

13  4 

14  4 

15  4 

16  3 

17  5 

18  5 

19  5 

20  4 


155  3 

156  4 

157  5 

158  5 

159  5 

160  5 

161  4 

162  3 

163  3 

164  5 

165  5 

166  5 

167  4 

168  4 

169  5 

170  4 


0 

-0.8614 

-1.5672 

1.9150 

0.8849 

-9.3647 

1.2713 

1.6414 

2.9985 

3.2093 

0.3170 

0.6723 

0.4002 

0.4562 

1.3955 

1.9070 


2.3290 

2.8385 

-0.4474 

1.5170 

1.6898 

2.2439 

-0.5436 

0.3131 

2.9744 

1.4940 

2.7775 

1.9622 

0.8564 

0.7604 

0.5422 

0.1764 


f^mk,k 

0 

0.6922 

1.2363 

-1.4001 

-0.6401 

6.8531 

-0.9156 

-1.1824 

-2.1536 

-2.3045 

-0.2468 

-0.5221 

-0.3101 

-0.3666 

-1.0776 

-1.4757 


-1.8636 

-2.2656 

0.3668 

-1.2021 

-1.3382 

-1.7720 

0.4407 

-0.2332 

-2.3248 

-1.1744 

-2.1773 

-1.5328 

-0.6573 

-0.5650 

-0.3945 

-0.1124 


1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 


1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 

1.4892 


0 

0.0203 

0.0206 

0.0614 

0.0562 

0.0170 

0.0422 

0.0138 

0.0153 

0.0091 

0.0411 

0.0482 

0.0401 

0.0425 

0.0467 

0.0166 


0.0049 

0.0132 

0.0280 

0.0356 

0.0356 

0.0357 

0.0185 

0.0144 

0.0240 

0.0182 

0.0225 

0.0255 

0.0342 

0.0353 

0.0329 

0.0257 


1.2404 

1.4636 

1.4996 

-0.5243 

0.3397 

1.4967 

1.4892 

0.9651 

-1.7912 

0.7281 

1.4999 

1.3425 

0.2017 

0.3349 

1.4892 

1.4933 


1.0646 

1.0755 

1.5024 

1.5540 

1.1792 

1.4624 

1.4976 

1.4375 

1.2378 

0.7835 

1.4995 

1.1941 

0.7930 

1.4061 

0.6155 

1.3552 


Tables  10-11  show  the  estimates  for  the  e-  sub-optimal  size  rhk,  the  parameters  /3mk,k  ,  Hntk,k  ,  Srrtk,k,  <Jmk,k,  and 
7 mk,k  for  the  U.  S.  Treasury  Bill  Yield  Interest  Rate  and  U.  S.  Eurocurrency  Exchange  Rate,  respectively.  The  initial  real 
data  time  is  tr  =  t$. 
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Using  e  =  1  x  10~3,  r  =  5,  and  p  =  2,  the  e—  level  sub-optimal  estimates  of  parameters  /3,  /x, 
5,  a  and  7  for  each  Treasury  bill  real  data  set  and  U.S.  Eurocurrency  rate  data  sets  are  exhibited  in 
Tables  10  and  11,  respectively. 

Next,  we  show  the  graphs  of  <Jmk ,fc,  and  7^7  for  the  Monthly  Treasury 

bill  data  set  and  Monthly  U.  S.  Eurocurrency  data  set. 


Graph  (5m  k  against  tk 


Graph  6m  k  against  tk 


Graph  ym  k  against  tk 


Graph  k  against  tk 


Graph  am  k  against  tk 


Figure  16.:  (3^^  ,  Vmk,k  ,  $nik,k,  &mk,k,  and  7,^7  for  Interest  rate. 
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Figures  16:  (a),  (b),  (c)  and  (d)  are  the  graphs  of  the  parameters  prtth,k  ,  Hmk,k  ,  $rnk,k,  & ntk,k,  and  ‘yrrik,k  against 
time  tk  for  the  U.S.  Treasury  bill  yield  respectively. 

The  next  figures  show  the  graphs  of  the  parameters  ,  lhnk,k  ,  ^mk,k,  °nik,k,  and  7„ifcifc  for 

the  Eurocurrency  Exchange  rate  respectively. 


Graph  p  k  against  t 


Graph  6m  k  against  tk 


Graph  k  against  tk 


Graph  am  k  against  tk 


Graph  ym  k  against  tk 


Figure  17.:  ,6nik:k  ,  0mk,k,  and  7 for  US  Eurocurrency. 
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Figures  17:  (a),  (b),  (c)  and  (d)  are  the  graphs  of  the  parameters  Pntk,k  ,  ymk,k  ,  6rnk,k,  <?mk,k,  and  jrnk,k  against 
time  ffc  for  the  US  Eurocurrency  exchange  rate  respectively. 

The  overall  descriptive  statistics  of  data  sets  regarding  U.  S.  Treasury  Bill  Yield  Interest  Rate  and 
U.  S.  Eurocurrency  Exchange  Rate  are  recorded  in  the  following  table. 


Table  12:  Descriptive  Statistics  for  Prhk,k,  Pmk,k,  $mk,k,  &mk,k,  and  7 mk,k  for  Interest  rate  data  set. 


Y 

Std(Y) 

P 

Std  (p) 

y 

Std  (11) 

5 

Std(<5) 

( 7 

std(cr) 

7 

Std(7) 

0.05667 

0.0268 

0.8739 

1.8129 

-3.8555 

8.7608 

1.4600 

0.00 

0.3753 

0.5197 

1.4877 

0.1357 

Table  13:  Descriptive  Statistics  for  @rhk,k,  Pmk,k,  $mk,k,  <?mk,k,  and  Ymh.k  for  US  Eurocurrency 
Exchange  Rate  data. 


Y 

Std(Y) 

P 

Std(/3) 

y 

Std(/.t) 

5 

Std(<5) 

a 

std(u) 

7 

Std(7) 

1.6249 

0.1337 

1.5120 

2.1259 

-1.1973 

1.6811 

1.4892 

0.00 

0.0243 

0.0180 

1.08476 

1.0050 

Tables  12  and  13  show  the  descriptive  statistics  for  Prhk,k,  ymk,k,  Srhk,k ,  &mk,k,  and  7 mk,k  with  time  delay  r  =  5 
for  the  U.S.  Treasury  Bill  Yield  interest  rate  data  set  and  the  U.  S.  Eurocurrency  exchange  rate  data  set,  respectively. 

In  Table  14,  we  show  the  result  for  the  real,  simulated  data  using  the  local  lagged  adapted  general¬ 
ized  method  of  moment  (LLMM),  and  the  simulated  price  (AGMM)  using  the  aggregated  parameter 
estimates  j3,  jl,  delta,  a  and  7  in  Table  12  and  13  for  the  U.  S.  Treasury  Bill  Yield  interest  rate  and 
U.  S.  Eurocurrency  exchange  rate  respectively.  The  simulated  price  using  the  aggregated  parameter 
(AGMM)  satisfies  the  discrete  model 

y-9  =  vT- 1  +  {hT- 1  +  KvT-if)  +  Hvt-iV  aw*.  (7.io) 
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Table  14:  Estimates  for  Real,  Simulated  Price  using  LLGMM,  Simulated  Price  using  AGMM 
method  for  U.S.  Treasury  Bill  Yield  Interest  Rate  and  U.S.  Eurocurrency  Exchange  Rate  respec¬ 
tively. 


^ k 

Interest  Rate  Data 

t k 

Eurocurrency  Rate 

Real 

Simulated 

Simulated 

Real 

Simulated 

Simulated 

LLGMM 

AGMM 

Real 

LLGMM 

AGMM 

5 

0.0357 

0.0357 

0.0400 

5 

1.6830 

1.6830 

1.6530 

6 

0.0364 

0.0357 

0.0390 

6 

1.7446 

1.6830 

1.8876 

1 

0.0384 

0.0365 

0.0390 

7 

1.8592 

1.7596 

1.9952 

8 

0.0381 

0.0378 

0.0388 

8 

1.8702 

1.8735 

1.8702 

9 

0.0393 

0.0387 

0.0399 

9 

1.8837 

1.8884 

1.8837 

10 

0.0393 

0.0406 

0.0401 

10 

1.9609 

1.9191 

1.9609 

11 

0.0393 

0.0389 

0.0503 

11 

1.9375 

1.9768 

1.7307 

12 

0.0389 

0.0393 

0.0612 

12 

1.9140 

1.8514 

1.7245 

13 

0.0380 

0.0386 

0.0570 

13 

1.9682 

1.9754 

1.7191 

14 

0.0384 

0.0391 

0.0301 

14 

1.9236 

1.9405 

1.6657 

15 

0.0384 

0.0390 

0.0384 

15 

1.7328 

1.8728 

1.6403 

16 

0.0392 

0.0385 

0.0174 

16 

1.7241 

1.8953 

1.5961 

17 

0.0403 

0.0392 

0.0223 

17 

1.7074 

1.7509 

1.5929 

18 

0.0409 

0.0385 

0.0299 

18 

1.6258 

1.6628 

1.5638 

19 

0.0438 

0.0399 

0.0449 

19 

1.6732 

1.6517 

1.6017 

20 

0.0459 

0.0444 

0.0419 

20 

1.6732 

1.7021 

1.6785 

390 

0.0503 

0.0503 

0.0303 

119 

1.6011 

1.6032 

1.6029 

391 

0.0491 

0.0517 

0.0371 

120 

1.6371 

1.5963 

1.6102 

392 

0.0503 

0.0503 

0.0501 

121 

1.6145 

1.6177 

1.6058 

393 

0.0501 

0.0505 

0.0556 

122 

1.5865 

1.5830 

1.6061 

394 

0.0514 

0.0492 

0.0488 

123 

1.5985 

1.6186 

1.5350 

395 

0.0516 

0.0510 

0.0506 

124 

1.5528 

1.5541 

1.5936 

396 

0.0505 

0.0484 

0.0409 

125 

1.4948 

1.5341 

1.5197 

397 

0.0493 

0.0503 

0.0530 

126 

1.5138 

1.5244 

1.6091 

398 

0.0505 

0.0494 

0.0532 

127 

1.4922 

1.4558 

1.6737 

399 

0.0514 

0.0496 

0.0395 

128 

1.4644 

1.4518 

1.6588 

400 

0.0495 

0.0512 

0.0471 

129 

1.4675 

1.4777 

1.5698 

402 

0.0514 

0.0496 

0.0184 

131 

1.4416 
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Next,  we  show  the  graphs  of  the  simulated  data  set  for  the  Treasury  bill  yield  interest  rate  and  US 


Eurocurrency  exchange  rate  data. 


Real,  Simulation  Interest  Rate 


Real,  Simulation  US  $  Eurocurrency  rate 


Figure  18.:  Real  and  Simulated  price  for  Interest  rate  and  U.S.  Eurocurrency  rate. 


Figures  18(a)  and  (b)  show  the  real  and  simulated  price  for  U.S.  Treasury  bill  yield  interest  rate  and  U.S.  Eurocurrency 
exchange  rate  respectively. 

In  the  work  of  Chan  et  al  [15],  they  compared  the  ex  post  volatility  (defined  by  the  absolute  value 
of  the  change  in  Treasury  bill  yield  data  set)  with  the  simulated  volatility  (  defined  by  the  square 
root  of  the  conditional  variance  implied  by  the  estimates  of  the  the  solution  of  (6.42).  It  is  calculated 

/  \  &rh^,k 

as  amk  ,k  (  y'rri!  k  )  )■  In  order  to  compare  our  work  with  Figure  1  of  Chan  et  al  [15],  we  use  our 

approach/scheme  to  compute  the  Ex  post  volatility  and  simulated  volatility  for  the  U.S.  Treasury 
bill  yield  interest  rate  data  set  [128]. 


Real  &  Simulated  Volatility 
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Figure  19.:  Ex  Post  Volatility  and  Simulated  Volatility  for  Interest  Rate. 
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Figures  19  shows  the  Ex  post  volatility  and  simulated  volatility  for  the  U.S.  Treasury  bill  yield  interest  rate  data  set 
[128].  We  compare  our  work  with  Figure  1  of  Chan  et  al  [15].  Their  model  does  not  clearly  estimate  the  volatility.  It 
demostrated  insensitivity  in  the  sense  that  it  was  unable  to  capture  most  of  the  spikes  in  the  interest  rate  ex  post  volatility 
data  set. 

Finally,  in  Figure  20,  we  show  the  graphs  of  comparison  of  the  real  price,  simulated  price  using 
the  LLGMM  method  and  the  simulated  price  AGMM  method. 


Figure  20.:  Real,  Simulation  using  LLGMM,  and  Simulated  Price  using  AGMM  for  U.S.  Treasury 
Bill  Yield  Interest  Rate  and  U.S.  Eurocurrency  Exchange  Rate. 


Figures  20  (a)  and  (b)  show  the  real,  simulated  price  using  LLGMM.  and  simulated  price  using  the  average  parameters 
j3,  jX ,  5,  a  and  7  in  Table  12  and  13  for  U.S.  Treasury  Bill  Yield  Interest  Rate  and  U.S.  Eurocurrency  Exchange  Rate 
respectively. 
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Chapter  8 
Forecasting 


8.1  Introduction 

In  this  chapter,  we  shall  sketch  an  outline  about  forecasting  problem.  An  e—  sub-optimal  simulated 
value  y*il  f  k  at  time  tk  is  used  to  define  a  forecast  yjni  k  for  yk  at  the  time  t/.  for  each  of  the  Energy 
commodity  model,  and  the  U.  S.  Interest  rate  and  U.S.  Eurocurrency  exchange  rate. 

8.2  Forecasting,  Prediction  and  Confidence  Interval  for  Energy  Commodity  Model 

In  the  context  of  Illustration  6.4.1,  we  begin  forecasting  from  time  tk.  Using  the  data  set  up  to 
time  tk- 1,  we  compute  rfi,,  of(.  «mt /t  and  /x/rij  A  for  i  €  1(0,  k  —  1).  We  assume  that  we  have  no 
information  about  the  real  data  set  {yi}fLk.  Under  these  considerations,  imitating  the  computational 
procedure  outlined  in  Section  6.4  and  using  (6.40),  we  find  the  estimate  of  the  forecast  k  at  time 
tk  as  follows; 

Vmk,k  Vmic-itk— lZ/mfc_i,fc— 1  (Mrhfc_i,fc— 1  ymk-\,k— l)  ^'~\~(Tfak—\,k—  l2/mfe_1,fc—  1 

(8.1) 

where  the  estimates  fc_1,  ,  j,:_ 1  and  Hfhk-i,k-i  arc  defined  in  (6.40)  with  respect  to  the 

known  past  data  set  up  to  the  time  tk-i-  We  note  that  yj-ni  k  is  the  e-sub-optimal  estimate  for  yk  at 
time  tk  ■ 

To  determine  y,£fc+1  k-  i  ’  we  need  c%k  fe,  Umk.,k  and  /xmfc/..  Since  we  only  have  information  of  real 
data  up  to  time  tk-i,  we  use  the  forecasted  estimate  yjhf  k  as  the  estimate  of  yk  at  time  tk,  and  to  esti¬ 
mate  of-  h,  dm,  k  and  Em i  k-  Hence,  we  can  write  a™,  k  as  a™,  k  =  a  -  /  . 

We  can  also  re-write  u™ ,  i.  =  ii .  f  .  To  find  y  ~  ,  „,we  use  the  es- 

rmk,K  A  ymk+2,k+ 2’ 

timates 


arhk+1,k+l 


a . 


^fc+1  iVk  —  rh^-\-2iyk  —  m^.+3  v?2/fe  —  1 


f 


rhk,k’yrhk+1,k+l 


f 


Emfc+iT'+l 
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Continuing  this  process  in  this  manner,  we  use  the  estimates 


am,k+i-i,k+i-l 

Hihk+i-i,k+i—l 


a  „ 

—  1  iUk  —  rhfc+i  iVk  —  m^+i+1 

J 

a , 

^k+i  —  1  tUk  —  rhfc+iiyk  —  m^+i+l  r 

f  f 

■■'Vk-l^ymk^k'ymk+1,k  +  l’- 

■■’ymk  +  1,k+i-l 

to  estimate  yik+uk+i 

Prediction/Confidence  Interval  for  Energy  Commodities 


In  order  to  be  able  to  assess  the  future  certainty,  we  also  discuss  about  the  prediction/confidence 
interval.  We  define  the  100(1  —  a)%  confidence  interval  for  the  forecast  of  the  state  yt  .  at  time  tt, 

1/2  f  ■  (  O  \!/2  r 

is  the  estimate 


i>k,as  y^.-  ±  Zl_a/2  where  i-i) 

for  the  sample  standard  deviation  for  the  forecasted  state  derived  from  the  following  iterative  process 


yfmk,k  =  yLk_uk-i+a™k-i,k-iyik_1,k-i(v™k_1,k-i-yik_uk-1)At+a1nk_1,k-iyik_uk-1AWk. 

(8.2) 

It  is  clear  that  the  95  %  confidence  interval  for  the  forecast  at  time  t,;  is 

(yfrhhi  ~  L96  (4^-1)  '  yfmi_1,i-Vyfrhi,i  +  1M(s2mi-1,i-l)  1  vL^i- 1) 


where  the  lower  end  denotes  the  lower  bound  of  the  state  estimate  and  the  upper  end  denotes  the 
upper  bound  of  the  state  estimate. 


Real,  Simulated  and  Forecast  for  Natural  Gas 


Real,  Simulated  and  Forecast  for  Crude  oil 
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Real,  Simulated  and  Forecast  for  Coal  Real,  Simulated  and  Forecast  for  Ethanol 


Figure  21.:  Real,  Simulated  and  Forecasted  Prices  for  daily  Flenry  Flub  natural  gas,  daily  crude  oil, 
daily  coal,  and  weekly  ethanol  data  set. 


Figures  21:  (a),  (b),  (c)  and  (d)  show  the  graph  of  the  forecast  and  95  percent  confidence  limit  for  the  daily  Henry 
Hub  Natural  gas  data  set  [24],  daily  Crude  Oil  data  set  [23],  daily  Coal  data  set  [22],  and  weekly  Ethanol  data  set  [136], 
respectively.  Figure  21:  (a),  (b),  (c)  and  (d)  show  two  region:  the  simulation  region  S  and  the  forecast  region  F.  For 
the  simulation  region  S,  we  plot  the  real  data  set  together  with  the  simulated  data  set  as  described  in  Figure  11.  For 
the  forecast  region  F .  we  plot  the  estimate  of  the  forecast  as  explained  in  Section  8.  The  upper  and  the  lower  simulated 
sketches  in  Figure  21  (a),  (b),  (c)  and  (d)  are  corresponding  to  the  upper  and  lower  ends  of  the  95%  confidence  interval. 
For  details,  see  Figure  22. 


Next,  we  show  a  graph  of  the  upper,  least  upper  bound,  lower  and  greatest  lower  bounds  for  the 
estimates  of  the  forecast  for  the  energy  commodity  processes  after  running  the  simulations  for  25 
times. 
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Bounds  for  Coal  Prices 


Bounds  for  Ethanol  Prices 
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Figure  22.:  Bounds  for  daily  Henry  Hub  natural  gas,  daily  crude  oil,  daily  coal,  and  weekly  ethanol 
data  set. 


Figures  22:  (a),  (b),  (c)  and  (d)  show  the  bounds  for  the  daily  Henry  Hub  Natural  gas  data  set  [24],  daily  Crude  Oil 
data  set  [23],  daily  Coal  data  set  [22],  and  weekly  Ethanol  data  set  [136],  respectively.  These  bounds  are  derived  after  25 
run  time  (simulations) 

8.3  Forecasting  and  Prediction/Confidence  Interval  for  U.  S.  Treasury  Bill  and  U.  S.  Eu¬ 
rocurrency  rate 

Following  the  same  procedure  explained  in  Section  8.2,  we  show  the  graph  of  the  real,  simulated, 
forecast  and  95  percent  confidence  limit  for  the  Interest  rate  and  US  dollar  Eurocurrency  rate. 

Real,  Simulated  and  Forecast  for  Interest  rate  Real,  Simulated  and  Forecast  for  US  Eurocurrency 


Figure  23.:  Real,  Simulated,  Forecast  and  95%  Confidence  Limit  for  Interest  rate  and  US  Eurocur¬ 
rency  data. 
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Bounds 


Figure  23(a)  shows  the  real,  simulated,  forecast  and  95  percent  confidence  limit  for  the  Interest  rate  data  sets  and 
Figure  23(b)  shows  the  real,  simulated,  forecast  and  95  percent  confidence  limit  for  the  US  Eurocurrency  data. 

Lastly,  we  show  some  bounds  for  the  U.  S.  Treasury  Bill  Interest  Rate  and  U.  S.  Eurocurrency 
rate. 


Bounds  for  Interest  rate 


Bounds  for  Exchange  Rate 


time  tk  (months) 


Figure  24.:  Bound  for  U.  S.  Treasury  Bill  and  U.  S.  Eurocurrency  rate. 
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Chapter  9 

A  Two-scale  Network  Dynamic  Model  for  Energy  Commodity  Process 


9.1  Introduction 

Understanding  the  economy  evolution  in  response  to  structural  changes  in  energy  commodity  net¬ 
work  system  is  important  to  professional  economists.  The  relationship  between  the  different  energy 
sources  and  their  uses  provide  insights  into  many  important  energy  issues.  The  qualitative  and 
quantitative  behavior  of  energy  commodities  in  which  the  trend  in  price  of  one  commodity  coin¬ 
cides  with  the  trend  in  prices  of  other  commodities,  have  always  raised  the  question  of  whether 
there  is  any  relationship  between  prices  of  energy  commodities.  If  there  is  any  relationship,  then 
what  comes  to  mind  is  the  extent  to  which  one  commodity  influences  the  other.  Petroleum,  natu¬ 
ral  gas,  coal,  nuclear  fuel,  and  renewable  energy  are  termed  as  primary  energy  components  of  the 
energy  goods  network  system  because  other  sources  of  energy  depend  on  them.  Natural  gas  is  usu¬ 
ally  found  near  petroleum.  This  is  because  of  the  fact  that  natural  gas  and  crude  oil  are  rivals  in 
production  and  substitutes  in  consumption.  As  a  result  of  this,  energy  theory  suggests  that  the  two 
prices  should  be  related.  The  electric  power  sector  uses  primary  energy  such  as  coal  to  generate 
electricity,  which  makes  electricity  a  secondary  rather  than  a  primary  energy  source.  According  to 
the  US  Energy  Information  Administration  (  EIA ),  the  major  energy  goods  consumed  in  the  United 
States  are  petroleum  (oil),  natural  gas,  coal,  nuclear,  and  renewable  energy.  The  majority  of  users 
are  residential  and  commercial  buildings,  industry,  transportation,  and  electric  power  generators. 
The  pattern  of  fuel  usage  varies  widely  by  sector  [130].  For  example,  71%  of  total  petroleum  oil 
provides  93%  of  the  energy  used  for  transportation;  23%  of  total  petroleum  oil  provides  17%  of 
energy  used  for  residential  and  commercial  use;  5%  of  total  petroleum  oil  provides  40%  of  energy 
used  for  industrial  use;  but  only  1%  of  total  petroleum  oil  provides  about  1%  of  the  energy  used  to 
generate  electric  power,  whereas  coal  provides  46%  of  the  energy  used  to  generate  electric  power 
and  natural  gas  provides  20%  of  the  energy  used  to  generate  electric  power.  This  analysis  suggests 
that  the  strength  of  interactions  between  coal  and  electricity  will  be  stronger  than  when  compared 
with  the  strength  of  interactions  between  crude  oil  and  electricity,  or  natural  gas  and  electricity. 
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Energy  price  forecasts  are  highly  uncertain.  We  might  expect  the  price  of  the  natural  gas  and 
crude  oil  to  follow  the  same  trend  because  they  arc  often  found  mixed  with  oil  in  oil  wells,  and  also 
of  the  fact  that  natural  gas  is  often  used  in  petroleum  refining  and  exploration.  Recently,  Ramberg  et 
al  [94]  showed  that  the  cointegration  relationship  between  natural  gas  and  crude  oil  does  not  appear 
to  be  stable  through  time.  They  claimed  that  though  there  is  cointegration  between  the  two  energy 
prices,  but  there  arc  also  recurrent  exogeneous  factors  such  as  seasonality,  episodic  heat  waves,  cold 
waves  and  supply  interruption  from  hurricane  affecting  the  trends  in  the  prices.  Brown  and  Yiicel 
[12]  also  observed  that  the  price  of  natural  gas  pulled  away  from  oil  prices  in  2000,  2002,  2003  and 
late  2005.  Oil  prices  arc  influenced  by  several  factors,  including  some  that  have  mainly  short-term 
impacts  and  other  factors,  such  as  expectations  about  future  world  demand  for  petroleum,  other 
liquids  and  production  decisions  of  the  Organization  of  the  Petroleum  Exporting  Countries  (OPEC) 
[130].  Supply  and  demand  in  the  World  oil  market  arc  balanced  through  responses  to  price  move¬ 
ment  with  considerable  complexity  in  the  evolution  of  underlying  supply  and  demand  expectation 
process.  For  the  petroleum  and  other  liquids,  the  key  determinants  of  long-term  supply  and  prices 
can  be  summarized  in  four  broad  categories  [130]:  the  economics  of  non-OPEC  supply,  OPEC  in¬ 
vestment  and  production  decisions,  the  economics  of  other  liquids  supply,  and  World  demand  for 
petroleum  and  other  liquids.  According  to  the  US  Energy  Information  Administration  (  EIA  )  [130] 
and  following  the  decline  of  natural  gas  prices  since  2008,  real  average  delivered  price  for  electric¬ 
ity  has  dropped  gradually  to  9.8  cents  per  kilowatthour  (kWh)  from  2009  to  2012.  Retail  electricity 
price  is  influenced  by  the  fuel  price,  and  particularly  by  the  natural  gas  price  [130].  However,  the 
relationship  between  retail  electricity  price  and  natural  gas  price  is  complex.  Many  factors  influence 
the  degree  to  which  and  the  time  frame  over  which  they  arc  linked.  A  few  notable  factors  arc  a  share 
of  natural  gas  generation  in  a  region,  the  level  of  costs  associated  with  the  electricity  transmission 
and  distribution  systems,  the  mix  of  competitive  versus  cost-of-service  pricing,  and  the  number  of 
customers  who  purchase  power  directly  from  wholesale  power  markets.  As  a  result  of  this,  it  can 
take  time  for  changes  in  fuel  price  to  affect  electricity  price.  The  question  that  we  arc  now  faced  is 
whether  the  price  of  electricity  depends  on  the  prices  of  more  than  one  energy  commodities,  rather 
than  depending  on  only  one  commodity  (coal  or  natural  gas). 

An  understanding  of  how  changes  in  price  of  one  energy  commodity  arc  expressed  in  terms  of 
other  energy  commodity  is  needed.  This  would  prove  to  be  useful  in  predicting  price  behavior  over 
the  long  run,  and  further  facilitates  profit  maximizing  process.  To  check  if  there  is  really  indeed 
a  relationship  between  energy  commodities;  the  need  to  be  able  to  create  a  model  which  explains 
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such  commodity  prices  relationship  over  short  and  long  time  interval  arises.  The  relationships 
between  energy  commodities  have  been  addressed  in  [4,  12,  39,  40,  49,  93,  94,  131,  132],  The  error 
correction  model  [4,  12,  39,  49,  93,  94]  is  the  most  commonly  used  model  by  authors  to  describe 
the  relationship  between  energy  commodities.  Moreover,  Hartley  et  al  [49]  have  concluded  that 
the  U.  S.  natural  gas  and  crude  oil  remain  linked  in  their  long-term  movements.  In  addition,  it  is 
exhibited  that  there  is  strong  evidence  of  stable  relationship  between  these  two  energy  commodities 
which  are  affected  by  short  run  seasonal  fluctuations  and  other  factors.  The  rule  of  thumb  [49]  has 
long  been  used  in  the  energy  industry  to  relate  the  natural  gas  prices  to  crude  oil  prices.  The  rule 
denoted  by  the  10-to-l  rule  states  that  the  price  of  natural  gas  is  one  tenth  of  the  price  of  crude  oil 
prices.  Similarly,  6-to-l  rule  states  that  the  price  of  natural  gas  is  one  sixth  of  the  price  of  crude 
oil.  It  has  been  examined  by  Brown  et  al.  [12]  that  these  two  rules  do  not  perform  well  when  used 
to  assess  the  relationship  between  U.S  natural  gas  price  and  West  Texas  Intermediate  (WTI)  crude 
oil  price  for  the  past  20+  years.  Moreover,  their  error  correcting  model  specify  the  relationship 
between  the  two  commodities.  Using  this  model,  they  show  that  when  certain  factors  are  taken 
into  account,  movements  in  crude  oil  prices  can  shape  the  price  of  natural  gas.  Vezzoli  [131]  in  his 
work  applies  an  ordinary  least  squares  (OLS)  regression  on  log  of  natural  gas  and  crude  oil  prices. 
Using  this  model,  he  was  able  to  conclude  that  there  is  a  relationship  between  natural  gas  and  crude 
oil  prices.  Bachmeir  et  al.  [4]  showed  that  the  crude  oil,  coal  and  natural  gas  in  the  United  States 
have  weak  cross-cointegration  using  the  error  correction  model.  Ramberg  et  al  [94]  shows  that  any 
simple  formula  between  natural  gas  and  crude  oil  prices  will  leave  a  portion  of  the  natural  gas  price 
unexplained.  Furthermore,  the  relationship  between  natural  gas  and  crude  oil  using  a  vector  error 
correction  model  [12,  94]  under  the  cointegration  between  the  two  energy  commodities  and  other 
factors  such  as  recurrent  exogeneous  factors  are  presented.  Vi  liar  et  al.  [132]  lists  some  economic 
factors  linking  natural  gas  and  crude  oil  prices,  while  testing  for  market  integration  in  the  United 
Kingdom  during  the  time  when  natural  gas  was  deregulated.  Asche  et  al.  [40]  have  integrated  the 
prices  of  the  energy  commodities:  natural  gas,  electricity,  and  crude  oil. 

The  most  of  the  work  is  centered  around  the  relationship  between  prices  of  energy  commodities. 
In  this  work,  we  are  interested  in  an  inter-dependence  of  certain  energy  commodities.  Moreover,  we 
develop  a  hybrid  system  of  multivariate  continuous  stochastic  network  dynamic  system. 

In  this  chapter,  we  further  extend  the  non-linear  interconnected  stochastic  model  (4.11)  to  multi¬ 
variate  interconnected  energy  commodities  and  sources  with  and  without  external  random  interven¬ 
tion  processes. 
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9.2  Model  Derivation 


We  denote  p  =  \j)\ ,  p-z, , . . ,  pn } 1  to  be  a  vector  of  n  energy  commodity  prices  which  arc  considered 
to  have  long-run  or  short-run  relationship  with  each  other.  Let  Pj(t)  be  the  price  of  the  j-th  energy 
commodity  at  time  t.  The  economic  principles  of  demand  and  supply  processes  suggest  that  the 
price  of  a  energy  commodity  will  remain  within  a  given  finite  expected  lower  and  upper  bounds. 
Therefore,  Uj  €  M+  =  (0,  oo)  and  lj  >  0  stand  for  the  expected  upper  and  lower  limits  of  the 
j-th  energy  commodity  spot  prices,  respectively.  In  the  absence  of  interactions  between  the  energy 
commodities  pj,  j  e  1(1,  n),  where  I (a,  b)  =  {z  £  Z  |  a  <  z  <  b},  the  market  potential  for  the  jth 
commodity  per  unit  of  time  at  time  t  can  be  characterized  by  (uj  —  pj)  (lj  +Pj).  This  simple  idea 
leads  to  the  following  economic  principle  regarding  the  dynamic  of  the  price  p3  of  the  jth  energy 
commodity.  The  change  in  spot  price  of  the  j-th  energy  commodity  A Pj(t)  =  pj(t  +  At)  —  Pj(t) 
over  the  interval  of  length  At  is  directly  proportional  to  the  market  potential  price. 

A pj(t)  oc  (uj  -  pj)  (lj  +Pj)  At.  (9.1) 

This  implies  that 

dpj  =  cij  ( Uj  -  pj)  (lj  +  pj)  dt ,  (9.2) 

for  some  constant  ay.  From  this  deterministic  mathematical  model,  if  otj  >  0,  we  note  that  as  the 
price  falls  below  the  expected  price  Uj,  the  price  of  the  jth  commodity  rises,  and  as  the  price  lies 
above  Uj,  there  is  a  tendency  for  the  price  to  fall.  Similar  argument  follows  if  ay  <  0.  Hence 

lira  pj(t)  =  Uj,  (9.3) 

t — TOO 

which  implies  that  Uj  is  the  equilibrium  state  of  (9.2). 

In  a  real  World  situation,  the  expected  upper  price  limit  Uj  of  the  j-th  commodity  is  not  a  constant 
parameter.  It  varies  with  time,  and  moreover  it  is  subject  to  random  environmental  perturbations. 
Therefore,  we  consider 

uj  =  yj  +  £ji  (9-4) 

where  is  a  white  noise  process  that  characterizes  the  measure  of  random  fluctuation  of  the  upper 
price  limit  of  the  j-th  commodity;  here  y}  stands  for  the  mean  of  the  energy  spot  price  process  of 
the  j-th  commodity  at  time  t.  It  is  further  assumed  that  yj  is  governed  by  a  similar  dynamic  forces 
described  in  (9.2),  that  is, 

dyj  =  Uj  (Uj  -  Vj)  (Vj  +  yj)  dt,  (9.5) 
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where  Hj  >  0  is  defined  as  the  mean  reversion  rate  of  the  mean  of  the  j-th  commodity,  Vj  >  0  is 
defined  as  the  lower  limit  of  the  mean  of  the  j-th  commodity.  By  following  the  argument  used  in 
(9.4),  we  incorporate  the  effects  of  random  environmental  perturbations  into  the  lower  limit  Vj  of 
the  mean  of  the  j-th  commodity: 

yj=vj  +  ej,  (9.6) 

where  Vj  >  0,  and  ej  is  a  white  noise  process  describing  the  measure  of  random  influence  on  the 
mean  price  of  the  j-th  commodity. 

Substituting  expressions  in  (9.4)  and  (9.6)  into  (9.2)  and  (9.5),  respectively,  we  obtain 


dyj  =  fij  ( uj  -  yj )(vj  +  yj )  dt  +  pj  (Uj  -  yj )ej(t)dt 
dpj  =  a.j  (yj  -  pj)  ( lj  +  pj )  dt  +  ay  (lj  +  pj)  ( t)dt . 


(9.7) 


In  the  absence  of  interactions  and  using  (9.7),  the  system  of  stochastic  model  for  isolated  ex¬ 
pected  spot  and  spot  prices  processes  arc  described  by  the  following  non-linear  system  of  stochastic 
differential  equations: 


{dyj  =  Pj  ( Uj  -  yj)  (vj  +  yj)  dt  +  5jj  (■ Uj  -  yj)  dWjd(t),  yj(t0 )  =  yjo, 

dpj  =  oij  (yj  -  pj)  (lj  +pj)  dt  +  ajj  (lj+Pj)  dZjj(t),  pj(t0)  =  Pjo,  j  G  1(1,  n), 

(9.8) 

where 

{Pjej(t)dt  =  dj,jdWjj(t),  j=l,2,...,n, 
aj^j(t)dt  =  <jjjdZjj(t),  j=l,2 . n, 

and  $j,j,&i,j  arc  non-negative  for  j  =  1,  2, ...,  n. 

In  the  presence  of  interactions,  for  each  j  G  /( 1 ,  n) ,  we  consider  both  deterministic  and  stochastic 
interaction  functions.  For  each  j  6  1(1,  n),  we  define  the  j-th  aggregate  interaction  functions 
g j  :  [to,  oo)  x  Mn  — >  M  and  hj  :  [to,  oo)  x  Mn  — »•  M  for  the  jth  commodity  of  the  mean  energy  spot 
price  process  y  -(t)  and  the  energy  spot  price  process  p  -(t)  in  a  energy  commodity  market  network 
system,  respectively.  Moreover,  we  assume  that  these  functions  have  the  following  structural  forms; 


g j(t,  y)  =  g j(t,  kj^yi,  kjt2y 2,  -,  kj!nyn) 

hj(t,  p)  =  hj(t,  7j,lPl,  7j,2P2,  •••,  lj,nPn)i 


(9.9) 


where  kh,,  and  7 jj  are  elements  of  the  n  x  n  interconnection  matrices  and  E/(,  respectively.  In 
(9.9),  kjj  and  7 yy  :  M+  — >•  [0, 1]  represent  a  degree  of  interaction  of  the  j-th  commodity  with  z-th 
commodity  in  the  energy  commodity  market  network  system. 
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For  the  matrix  Eg,  =  0  with  fixed  i  €  1(1,  n)  if  the  i-th  commodity  in  the  energy  market 
network  system  does  not  influence  the  j-th  commodity.  Likewise,  for  the  matrix  E/,,  7 jj  =  0  with 
fixed  i  €  1(1,  n),  the  j-th  commodity  in  the  energy  market  network  system  sub-component  of  p  is 
totally  unaffected  by  the  influence  of  the  i-th  commodity. 

Finally,  we  introduce  interactions  in  the  diffusion  coefficients  with  respect  to  the  j-th  commodity 
of  the  energy  market  network  system  under  random  environmental  perturbations  as:  ■  :  [to,  00)  x 
Mn  — >  Mn  and  A j  :  [io,  00)  x  M"  ->  for  each  j  €  1(1,  n).  The  diffusion  paid  is  of  the  form 

'  n 

<  (9.10) 

I  Aj(t,p)  -ij(t)dt  =  E  Ajti(t,pi)dZjti(t), 

1=1 

where  e;/  and  £  ■  are  n-dimensional  white  noise  processes;  •  stands  for  dot  product. 

We  assume  that  the  interaction  functions  (9.9)  and  (9.10)  have  the  following  forms; 


g(*.y) 

=  l(t,y)G(t,y) 

h(t,p) 

=  X(t,  p)H(f,  p), 

ip(t,  y) 

=  i(t,y)^(t,y), 

k  A(f,p) 

=  \(t,  p)d?(L  p), 

where  g(i,y)  =  \&i(t,y),...,gj(t,y),...,gn(t,y)]T,  h(f,p)  =  [hi(f,p),  ...,hi(i,p),  ...,hn(f,p)]T 
are  defined  in  (9.9),  if>(t,  y)  =  {^j,i(t,y))nxn,  and  A(t,  p)  =  (A.j,i(t,p))nxn,nf(t,y)  =  diag(m- 
yi,-,Uj  -  yj, ..., un  -  yn)  and  X(t,p)  =  diag(h  +  pi,...,lj  +  pj.  ...,/„  +pn);  G,  and  H  are 
n  x  1  column  vectors;  fi/  =  diag(rp1, ...,  xj)j, ...,  rpn)  and  fi>  =  diag(  Ai, ...,  A  j, ...,  An)  are  block 
diagonal  matrices;  r/r,  =  ...,  i/>jj, Aj  =  [A71, ...,  A^j, ...,  Aj)Tl].  We  also  assume 

that  G,  H,  fir  and  fi>  satisfy  the  local  Lipschitz  condition.  This  assumption  implies  that  g,  h,  -0  and 
A  also  satisfy  local  Lipschitz  condition. 

Thus,  the  interconnected  energy  commodity  network  system  is  described  by 


dyj 

< 

dPj 


( u3  ~  yi) 

yj(t  0)  =  yjo, 


(Pj  (Vj  +  yj)  +  Gj(t,  y))  dt  +  Sj:jdWj:j(t)  +  E  'S?jjl(t,y)dWjti(t) 

1=1 


(lj  +  pj ) 


(otj  (yj  -  Pj )  +  Hj(t,  p))  dt  +  rrj.jdZjjd)  +  &jti(t,p)dZj:i(t) 


1=1 


Pj(t 0)  =PjO,  j  F  1(1, n), 


(9.11) 
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where  the  parameters  /ij  >  0;  a3  >  0;  Uj  >  0;  Vj  >  0;  lj  >  0;  Sjj  >  0;  a3,j  >  0;  and  for  j  /  l, 
5j,i  >  0;  (jj  i  >  0;  j,  l  £  7(1,  n);  for  j  £  1(1,  n),  Wj  and  Z  ;  are  n-dimensional  independent  Wiener 
processes  defined  on  a  filtered  probability  space  (Q, F,  (Ft)t>0i'P)\  for  l  /  E [dWjjdWkj]  =  0, 
and  for  l  =  i,  E [dWjjdWkj]  =  dt;  the  filtration  function  (Ft)t> o  is  right-continuous;  for  each 
7  >  0,  each  Ft  contains  all  P-null  sets  in  F\  the  n-dimensional  random  vectors  y(7o)  and  p(7o)  are 
Ft0  measurable. 

The  network  system  of  stochastic  differential  equations  in  (9.11)  can  be  written  as  follows; 


where 


a(7,y) 


b(7,y,p) 


[  r(t,  y) 

and 


dy  =  a(7,y)d7  + Y(7,y)dW(7),  y (70)  =  y0 
dp  =  b (7,  y,  p )dt  +  ar(t,  p)dZ(t),  p(t0 )  =  p0, 


1  (ui  -  yi)  [qi  (ni  +  yi)  +  Gi(7,  y)]  ^ 

(u2  -  y2)  \H2  (v2  +  7/2)  +  G 2(7,  y)] 

1 

y(^n  Vn)  \l^n  (^n  Vn)  “1“  y )]/ 

1  (h  +pi)  [a\  (yi  -  pi)  +  H\(t,  p)]  ^ 

(I2+P2)  [(*2  (2/2  -P2)  +  H2(t,p)] 

y(^n  T  Pn )  [ctn  (yn  Pn)  T  Hn(t ,  p)]y 

d*a^(Ai(y)^..,i4i(y),..,24n(y)),  <x(7,p)  =  d*a^(Bi(p), ...,  5j(p), ...,  Bn(p)), 


f  Ai(y) 

ii 

i 

*J,2  • 

••  *7,7- 1  <*7,7  + *7,7  Vjj+1 

••  *7,n) 

1  bj(p) 

-  (h  +Pj) 1 

*7,2  ■  • 

■  *7,7- 1  +  *7,7  *j,j+i  •  • 

'  *7,™)  ’ 

W  =  [Wi ,  ...Wj, ...,  Wn]r,  and  Z  =  [Zi,  ...Zj, ...,  Zn]T  are  block  matrices; 

Wj  =  [Wjti,...Wj!2,...,Wj!n]T,  Zj  =  [Ziii,...Zji2,-.-,2j,n]T;  and  Y(7,y),  <r(7,p)  are  a  n  x  n 


block  matrix  with  each  entries  having  order  1  x  n. 


In  the  next  section,  we  outline  the  model  validation  problems  of  (9.12),  namely,  the  existence  and 


uniqueness  of  solution  process. 
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9.3  Mathematical  Model  Validation 

In  this  section,  we  validate  the  mathematical  model  derived  in  Section  2.  We  note  that  the  classical 
existence  and  uniqueness  theorem  [57,  66]  is  not  directly  applicable  to  (9.12).  We  need  to  modify 
the  existence  and  uniqueness  results.  The  modification  is  based  on  Theorem  3.4  [57].  We  show  the 
global  existence  of  solution  process  of  system  of  differential  equations  (9.12). 

We  note  that  the  rate  functions  a,  b,  T,  and  a  in  stochastic  system  of  differential  equations  (9.12) 
do  not  satisfy  the  classical  existence  and  uniqueness  conditions  [57].  However  these  rate  functions 
do  satisfy  the  local  Lipschitz  condition.  Therefore,  we  construct  sequences  of  functions  for  the  drift 
and  diffusion  coefficients  of  interconnected  dynamic  system  (9.12)  so  that  the  classical  conditions 
for  existence  and  uniqueness  theorem  are  applicable.  The  construction  of  modification  scheme  is 
as  follows:  First,  we  define  a  cylindrical  subset  [to,  oo)  x  Um  of  [0,  oo)  x  Mn  for  to  G  [0,oo), 
m  G  7(1,  oo),  where  Um  is  an  n-  dimensional  sphere  with  radius  m  defined  by 

Um  =  B(xo,  m)  =  {x  G  Mn  :  ||x  — xo||<m}, 

for  any  rn  G  7(1,  oo).  We  note  that  Um  is  inscribed  in  n-dimensional  parallelepiped  M(x  —  xo,  m)  = 

[— m,m ]  x  ...  x  [— m,m ]  inMn. 

The  developed  stochastic  network  model  (9.12)  can  be  written  as: 


dy  =  am(t,  y)dt  +  Tm(t,y)7W(t),  y(t0)  =  y0 
dp  =  b m(t,  y,  p )dt  +  crm(t,  p)dZ(t),  p(t0)  =  P0, 


where 

am(t,y)  =  a(t,  q(y,  m)) 

Tm(t,y)  =  T(t,q(y,m)), 

bm(t,y,p)  =  b(t,  q(y,  m),  q(p,  m)), 

am(t,p)  =  a(t,  q(p,  m)). 

Here,  for  each  j  G  7(1,  n)  and  x  G  Mn,  we  define  q  -(x,  m)  =  max{— m,  min{xj  —  xq 
Hence,  q(x,  m)  =  [Qi(x>  m), ...,  qj(x,  m), ...,  qra(x,  m)]T,  and  it  is  denoted  by  x(-mK 


Remark  23  We  observe  that  q(x,  m)  satisfies  global  Lipschitz  condition  on  Mn  with  a  Lipschitz 
constant  1.  This  together  with  the  local  Lipschitz  condition  assumption  on  the  drift  and  diffusion  co¬ 
efficients  of  network  system  of  stochastic  differential  equations  (9.12),  the  modified  rate  coefficient 
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functions  in  (9.13)  satisfy  the  classical  existence  and  uniqueness  conditions  [57,  66].  Thus,  its  so¬ 
lution  is  denoted  by  (ym,  pm),  for  m  €  1(1,  oo).  Moreover,  it  is  assumed  that  (y,  p)  is  non-negative 
whenever  y0,  p0  €  . 


Now  we  apply  Theorems  3.4  and  3.5  of  [57]  in  the  context  of  modified  system  of  stochastic  dif¬ 
ferential  equations  (9.13)  and  Remark  23  to  establish  the  global  existence  of  solution  of  stochastic 
differential  equations  in  (9.13).  For  this  purpose,  we  outline  the  argument  used  in  the  proof  of  these 
theorems. 

In  addition  to  the  local  Lipschitz  conditions  on  the  drift  and  diffusion  coefficients,  we  further 
impose  the  following  hypothesis  on  the  coefficients: 

(Hi) 


(9.15) 


|gj(t,y)|  <  oij  +  «il|y||, 

IM*>p)I  ^  aij  +  7jIIpII> 

|^j,t(*,y)|  <  a2,j  +  5j}i\\y\\, 

{  |Aj,i(i,p)|  <  a2,j  +  Tj,t||p||- 

where  for  i  e  7(1,2),  aU],  ai  ■  arc  non-negative;  Kj,  7 j,  Sjj ,  ahi  £  M+.  From  (9.13),  we  further 
remark  that  dynamic  of  mean  of  spot  price  vector  y  is  decoupled  with  the  dynamic  of  spot  price  p. 
Now  we  first  apply  Theorems  3.4  and  3.5  of  [57]  in  the  context  of  modified  system  of  stochastic 
differential  equations  (9.13)  and  hypothesis  (Hi)  to  establish  the  global  existence  of  solution  of  the 
completely  decoupled  sub-system  of  stochastic  differential  equations  in  (9.13).  For  this  purpose, 
we  outline  the  argument  used  in  the  proof  of  these  theorems. 


DEFINITION  9.3.1  Let  Tm  be  the  first  exit  time  of  the  solution  process  y m  from  the  set  B(y0.  rn). 
Define  r  to  be  the  ( finite  or  infinite)  limit  of  the  monotone  increasing  sequence  Tm  as  m  — )•  00. 

r  =  lim  rm. 

m— >00 

We  wish  to  show  that 

V(t  =  00)  =  1.  (9.16) 

In  the  following,  we  present  a  result  that  is  parallel  to  Theorem  3.5  [57]  in  the  context  of  the 
completely  decoupled  sub-system  of  stochastic  differential  equation  (9.12).  For  this  purpose,  it  is 
enough  to  exhibit  the  global  existence  result  for  the  transformed  system  (9.13). 
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Lemma  9.1  For  m  G  /( l,oo),  and  y0  G  R™,  let  ym(t)  =  ym(t,to,y0)  be  the  solution  of  the 
completely  decoupled  sub-system  of  (9.13),  and  let  the  hypothesis  (H \  )  be  satisfied.  Let  V\  be  a 
function  defined  on  [to,  oo)  X  R”  into  R+,  it  is  defined  by; 

Vi{t,y)  =  ln(|[y||2  +  e),  (9.17) 

Then  there  exists  some  constant  c  \  >  0  such  that 

LV i  <  C\V\ 

<  (9.18) 

V\m  =  inf  Vi(t,y)  -A  oo  as  m  — >  oo, 
lbll>m 

where  L  is  the  differential  operator  with  respect  to  (9.12);  e  =  exp(l). 

Moreover,  the  global  existence  of  solution  of  the  completely  decoupled  sub-system  of  (9.12)  fol¬ 
lows. 


Proof. 

It  is  obvious  that  V\  G  C\t2  on  [to,  oo)  x  R™ 


.  In  fact. 


9Vi(t,y)  _  2y}  d2Vi(t,y)  _ 

dVj  (I  lyl  l2+e)  ’  dip 


ttt  I,2, :  r  —  !?J,  ,  9  YL(fy)  —  —  TTr^ff-yT  exist  and  are  continuous  functions  defined  on  [tn,oo)x 

(l|y|r+e)  (llylb+e)2’  oyiVj  (l|y||2+e)2  L  u’  ' 


R™  -A  R.  Moreover,  the  L-operator  with  respect  to  the  completely  decoupled  component  is  as 
follows: 


LLi(t,  y)  =  J2  [dl (u3  ~  VJ ) ( v3  +2 fj)+  §j (* ,  y)]  ^ 


7= 1 


+  E 


3= 1 


-  yf)  +  il>jj(t,y)]2  +  Y  tfA1’ y) 


d2Vx  (t,y) 


dy] 


+lYY 


i= 1  3= 1 


Y  +  2[Mu*  -  y%)  + 


Y^ 

3= 1 


Vi 


Uj  ~  Vj 


2  /  I  \  F 

+  (U3+  V3 


2^7 


+£ 


dWVt.y) 

dyiVj 

2  &j(t,y)yj 


+  9  E^'dK'  -  Vj)  + 


l|y||2  +  e)  ^(||y||2  +  e) 

4^7  \ 


i=i 

n  n 


|y||2  + e) 


2  +  e)2 


+oEE^i(t>y) 


4?/2 


7=i  ¥7 


+  e  (lly|l2  +  e) 
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EE 

1=1  j= 1 

ii=* 


Y  <M^)<M*>y)  +  2l6iAui  -  yi)  + 

ifrd 


<  2  ( Uj  +  Vj  \  2  Vj  a.  \  "  2gj(*’y^j  ,  \  ^ 

-  V  2  )  (llyll2  +  e)  +  “  (llyll2  +  e)  +  =; 

n  n  2 


+EE 

i=1  z^i 


+  e) 


EE 

i=i  j=i 


Y  y)  +  -  a/*)  + 

i&j 


<  2f:^f"^y+E(oij+^"y")2+y| 


1=1 


1=1 


+  e 


n  n  n 

+2  ^  ^  5jj(tlj  +  1)^  +  ((X2j  +  Sjj  )2]  +  Yl(az,j + 4o 


1=1 
n  n  n 


1=1  *^j 


+2  X]  (a2’*  +  (a2>i  +  ^j>i 

*=l  lY*  ^*,1 

nn 

+4  y^(a2,j  +  <4)  5i:i(ui  +  1)  +  (a2,j  +  Si,i) 

i=l  j^i 

<  ciVi(t,y), 


where  ci  =  1  +  2  £  ^  (^^4^ J  +  E(«i,i  +  «i)2  +  2  E  [^(“j 


2  n 


12  i  o  f\2 


n  n  n 


E  E(a2 ,j  +  ^',i)2  +  2  E  E  E  (a2,i  +  Si,l)  [a2,j  +  $j,l 

j=ll^j  i=l  jjti  lyti,j  v 

n  n  _  r  - 

+  4  4  E  (a2j  +  <4)  +  1)  +  ((12,1  +  ^1,1 ) 

Furthermore,  inf  Vi(f,y)  ->  oo  as  ro  -t  oo. 

Ily||>m 

To  show  that  V(t  =  oo)  =  1,  we  define  a  function 


V(i,y)  =  Vi(t,y)exp{-ci(*-to)}. 

It  is  obvious  that  LV  <  0.  By  defining  rm(t)  =  min(rm,f);  y(t )  = 
imitating  the  argument  of  Lemma  3.2  [57],  we  have 

E{Vi(rm(t),  y(rm(t)))  <  e'rt-^EVtfoMto))- 


Hence 


or  ^ ^  eCl(t-to)Eyi(f0 ,y(t0))  ,n  ,  u 

P {rm  <tj  <  - — - - r - >  0  as  m  ->  oo  b; 

mf  Fi(tt,y) 

||y||>m,ii>t0 


4  yiyj 

j’l\  (llyll2 +  e)2 

i(uj  -yj)  +  'i/>jj(t,y)]2 

(I  |y|  I2  + e) 

4  yiyj 

j ’*  (llyll2  +  e)2 


+  l)2  +  (fl2  ,j  T"  5jj)2  + 


(9.19) 

ym(f)  for  t  <  rm;  and 


(9.18).  (9.20) 
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The  global  existence  and  uniqueness  of  solution  of  the  first  component  of  (9.13)  follows  by  letting 
m  oo.  Hence,  from  this  and  the  fact  that  the  solution  process  of  transformed  system  (9.13) 
is  almost  surely  identical  with  the  solution  process  of  the  original  system  (9.12),  we  conclude  the 
global  existence  and  uniqueness  of  (9.12). 

□ 

Now  by  following  the  idea  of  Lemma  9.1,  we  present  a  global  existence  and  uniqueness  of  so¬ 
lution  of  the  system  of  stochastic  differential  equations  governing  the  sub-system  p  in  (9.12).  We 
simply  state  a  Lemma  without  the  full  proof. 


Lemma  9.2  Form  e  7(1,  oo),  and  y0,  p0  e  M”,  letpm(t )  =  Pm(t,to,p0)  be  the  solution  of  the 
system  of  stochastic  differential  equations  governing  the  sub-system  p  described  in  (9.13),  and  let 
the  hypothesis  (H\)  be  satisfied.  Let  V2  be  a  nonnegative  function  on  [to,  oo)  X  Wj_  into  M+  defined 
by; 

V2(Lp)  =  M\\pW2  +  e)  +  j2(Y  [  ( Vj{s)  +  lj)2ds,  (9.21) 

3= 1  Jt 

Then  there  exist  a  constant  c  >  0  such  that 

LV 2  <  cV-2 

<  (9.22) 

V2m  =  inf  V2(t,p)  — >  oo  as  m  — >  oo. 

Hp\\>™ 

where  L  is  the  differential  operator  with  respect  to  (9.12);  e  =  exp(l). 

Moreover,  the  global  existence  of  solution  of  the  system  of  stochastic  differential  equations  gov¬ 
erning  the  sub-system  p  described  in  (9.12)  follows. 


Proof.  It  is  obvious  that  V2  €  C \i2  on  [to,  oo)  xl 


.  In  fact. 


dVlb.p)  _  2 pj 

dpj  |||p|P+e) 


d2V2(t, p)  _ 

~  ninii2_ 


4p? 


|p||-+e) 

uous  functions  defined  on  [to,  oo)  x  M” 


3= 1 

9  — - —  exist  and  arc  contin- 


|p||2+e)2’  dPiPj  (||p||2+e)2 

Moreover,  the  L-operator  with  respect  to  the  system 

of  stochastic  differential  equations  governing  the  sub-system  p  described  in  (9.12)  is  as  follows: 
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L  v2(t,  p)  =  -  XX  y  ( Vjit )  +  Ijf  +  laj(Vj  -  Pj)(lj  +  Pj )  +  hj(t,  p)] 


4= i 


2 Pj 


3= 1 


|p|r  + e) 


+  E 


3=1 


cr 


(lj  +  pj)  +  Ajj(t,p)]  2+E^.p) 

¥4 


p|  r  +  e) 


4p2 


|p||2  +  e^2 


nEE 


^  '  AijAjj  -(-  2[(Ti)t(Zj  ~F  p?:)  H- 


i=l  j=l  U=1 
4^2 


4p.iPj 


jp||2  +  e)2 


X]  ~2  (yi  +  l^2  +  XX 


3=1 

n 

+E 


a;  - 


3=1 


Pj 


yj  h 


1  2 


+ 


(  Pj  +  h 

V  2 


2  Pj 


p  r  + e) 


2M*>P)P4 


jtt  CllPlr  +  e) 

1  n 

+  2  XX (^4  4-  Pj)  +  Ajj(t,  p)] 

4=i 


+  oXXXXAi^’p) 


4p: 


|p||2  +  e)  (||p||2  +  c)2 


j=i  ift 

n  n 

EE 

i=  1  j=l  U=1 

4^* 


IpI  r  + e)  (llPlr  +  e 


32 

J_3 _ 

2  ,0^2 


X  ^  A'jjAji  -F  2[aij(li  -F  pi)  -t-  Aij]Ajj 


Apipj 


^  ~^2~2 (yj +ij)2 (yj +ij) 


x2  Pj 


j= 1 


+E 


4=i 


|plr  + e, 


+  E 


p|  |2  +  e)2 

aij  +  74 1  IpI  |]2  +  p 


4=1 


IpI  r  +  e) 


((?  +  P4)  +  A4j(^P)]2 


4=1 

n  n 


IpI  r  + e) 


n  n  n 


+  XI  XXK,  +  cr44)2  +  2  XI  XI  XI  (a24  +  ai,l  )  [a2,j  +  aj,l 
4=1  i^4  *=l  4^*  i#,4 

n  n 

+4X1  XI^a2>4  ^4i®)  +  1)  +  («2,i  +  cr*,») 

2=1  4^* 

<  cF2(i,p), 


n  r 

where  c  =  1  +  E  Kj  +  74]2  +  2  E  °lj(h  +  l)2  +  (a2,j  +  ^4j)2  I  +  £  £  («2,j  +  <E*)2  + 
4=1  4=1  j=H¥=j 


n  n 

\2  1  (•  ,  ~  \2  1  1  Z-..\2 


n  n  n 


*=1  j&l&j 


2E  E  E  (a2  ,i  +  °i,l)  (a2  ,j  +  'Em)  +  4  E  E(a2  ,j  +  Vj,i)  aij(h  +  1)  +  (a2ji  +  <7j,i) 


*=1  4^* 


Furthermore,  inf  V2  m(t,  p)  — >  00  as  m  — >  00. 
I  IpI  I  >m  ’ 


□ 
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Following  the  final  argument  used  in  proving  the  global  existence  of  y  in  Lemma  9.1,  we  conclude 
that  there  exists  a  unique  global  solution  to  the  interconnected  system  of  stochastic  differential 
(9.12). 

In  the  next  section,  we  discuss  about  the  case  where  we  incorporate  jump  process  into  the  system 
(y,P). 


9.4  Energy  Commodity  Model  With  and  Without  Jumps 

Due  to  random  interventions  that  affects  the  price  of  energy  commodities,  we  introduce  random 
interventions  described  by  a  continuous  jump  in  our  model.  We  follow  the  approach  discussed  in 
[120, 138].  In  their  work,  Wu  [120,  138]  investigated  a  class  of  stochastic  hybrid  dynamic  processes. 

Let  K  0  be  the  number  of  jumps  on  the  interval  [to,  /.  for  / '  ;>  ( ) .  For  A  /  ( ) .  let  / ) . . . . .  / ' 
be  the  jump  times  over  a  time  interval  [to,  T]  such  that  to  =  To  <  T\  <  ...  <  Tk  <  T,  where 
Tj  denotes  the  time  at  which  the  i-th  jump  occurred  in  the  system  (y,p).  For  I\  =  0,  no  jump  has 
occurred  on  the  interval  [to,  T\.  We  denote  the  i-th  sub-interval  by  7)_i  <  t<  T,.  Knowing  the 
global  existence  and  uniqueness  solution  process  of  system  (9.12)  on  the  interval  [to,T],  T  >  0 
in  Section  9.3,  for  i  <G  7(1,  K *)  and  K  /  o,  we  consider  the  solution  process  on  each  subinterval 
[7)_i ,  Ti),  between  jumps,  where  K*  =  K  if  Tk  =  T,  and  K*  =  K  +  1  if  Tk  <  T.  For 
i  6  7(1,  K*)  and  K  =  0,  we  have  7(1,  K)  =  0  or  7(1,  A"*)  =  {1}.  In  this  case,  we  consider 
the  solution  process  on  [to,  T],  The  interconnected  system  is  governed  by  the  following  system  of 
continuous  time  stochastic  process; 


dyi  1 

=  a*-1(f,y)df  +  Ti_1(t,y)dW(t), 

’h 

iS>.  J 

i 

II 

T' 

t  €  [Ti-i,  Ti) 

dp*-1 

< 

=  bi_1(t,y,p)dt  +  p)dZ(t), 

P  (Ti-l)  =  P* 

t  €  [Ti-!,  Ti),  i  G  7(1,  A*[ 

y* 

,  p' 

=  0*p*— 1  (T^~ ,  7)_! ,  y*— 1 ,  p*— !)  , 

(9.23) 

where 

IT  =  diag  (7rj,7r£,  , 

0i:  =  diag 

(y*_1(t,  Tj_i,  y*_1),  p*_1(t,  Tj_i,yl_1,  p*-1))  is  the  solution  of  system  of  equation  (9.12);  for  K  / 
0  and  i  €  7(1, 77*),  II*  and  0*  are  jump  coefficient  matrices.  These  jump  coefficients  arc  estimated 
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by  7 H  = 


Vj  (Tj ) 


Pj  (Tj) 


_1  ._x  for  j  G  7(1,  n).  Following  the 


3  lim  y)  f  lim  p*  1(t,Ti_i,yi-1,pi-1) 

t—*T.  t—¥T. 

x  x 

approach  in  [120,  138],  the  solution  of  (9.23)  takes  the  following  representation: 


y(Mo,y0) 


=  < 


p(Mo,y0,Po)  = 


=  < 


y°  (Mo,y0)> 

O 

II 

■HO 

'"SC 

to  <  t  <  T\ 

y1  y1)  , 

y1  =y(Ti) , 

Ti<t<  T2, 

yi_1  (t,  Tj_!,  y*_ 

'),  yi_1  =  y  m- 

-i)  ,  T%- 1  <  t  < 

y  K(t,TK,yK), 

yK  =  y  (tk), 

TK<t<  T, 

p°  (Mo,y0>Po)> 

p(*o)  =  Po> 

to  <  t  <  Tj 

P1  {t,T- ’^ySp1) 

»  p1  =  p(Tl), 

Ti  <  t  <  T2 

P*— 1  (f  j -7i— t  j  y*- 1 5  P*— !)  !  p'-^pffi-t),  Ti^KtKTi, 
{  pK  (t,  TK,yK,pK)  ,  pA  =  p  (Tk)  ,  Tk  <t<T, 


(9.24) 


and  1(1, 0)  =  {i  G  Z  :  1  <  i  <  0}  =  0  and  7(1,  if*)  =  {1}  . 

Remark  24  For  no  jump,  that  is  K  =  0,  (9.23)  and  (9.24)  reduce  to 

dy  =  a(t,  y)di  +  Y(f,  y)dW(f),  y(t0)  =  y0 
dp  =  b(t, y,  p)di  +  cr(f,  p)dZ(f),  p(f0)  =  P0,  t0  <  t  <  T ; 


and 


respectively. 


y(Mo,y0)>  y(fo)  =  y0, 
p(Mo,y0>Po)>  p(*o)  =  P0>  *o  <  t  <  T, 


(9.25) 


(9.26) 


9.5  Multivariate  Discrete  Time  Dynamic  Model  for  Local  Sample  Mean  and  Covariance  Pro¬ 
cess 

In  this  section,  we  use  the  idea  of  moving  average  to  derive  an  algorithm  for  the  mean  and  covari¬ 
ance  of  sample  sequences  with  respect  to  a  continuous  time  stochastic  process.  The  development 
of  idea  and  model  of  statistic  for  mean  and  covariance  processes  is  motivated  by  the  state  and  pa¬ 
rameter  estimation  problems  of  continuous  time  nonlinear  stochastic  dynamic  model  of  the  energy 
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commodity  market  network  (4.11)  .  For  this  purpose,  we  need  to  introduce  a  few  definitions  and 
notations. 

For  each  i  £  7(1,  77*),  let  r*_i  and  7i_i,  be  finite  constant  time  delays  such  that  0  <  7i-i  < 
Tj_ i.  If  77  =  0,  then  there  is  no  jump.  Hence,  we  simply  write  t%-\  =  r  and  =  7.  Here 
t,_  j  characterize  the  influence  of  the  past  performance  history  of  state  of  dynamic  process.  yt~\ 
describe  the  reaction  or  response  time  delays.  In  general,  these  time  delays  are  unknown  and  random 
variables.  These  types  of  delays  play  an  important  role  in  developing  mathematical  models  of 
continuous  time  [64]  and  discrete  time  [59,  88]  dynamic  processes.  Based  upon  the  practical  nature 
of  data  collection  process,  it  is  essential  to  either  transform  these  time  delays  into  positive  integers 
or  design  a  suitable  data  collection  schedule  or  discretization  process.  For  this  purpose,  for  each 
i  £  7(1,  77*),  we  describe  the  discrete  version  of  time  delays  of  n  and  7,;  as  follows: 


f  ..  r 

T~i — 1 

11 

7 

A7_i 

+  1,  and  rji-i  = 


7i  — 1 


Ati-i 


+  1,  for  i  e  7(1,  77*). 


(9.27) 


Moreover,  for  the  sake  of  simplicity,  we  assume  that  0  <  7,-1  <  1,  (7,-1  =  1). 

Definition  9.5.1  Let  x  =  [x  1 ,  X2 , . ..,  i,,]7  be  a  continuous  time  multivariate  stochastic  process 
defined  on  an  interval  [to- t,  T]  into  W1,  for  some  T  >  0.  Fort  £  [to- t,  T],  let  Ft  be  an  increasing 
sub-sigma  algebra  of  a  complete  probability  space  (f.l.  J7,  V)  for  which  x(t)  is  Ft  measurable.  For 
each  i  £  7(1,  77*),  let  P  and  P*^1  be  a  partition  of  [to  —  r,  T ]  and  [7)_i  —  t*_i,  Tj],  respectively. 
The  partition  P*_1  is  derived  by  decomposing  the  partition  P.  For  each  i  £  7(1,  77*),  the  partitions 
P  and  P,  _1  are  defined  as  follows: 


=  {tfc  :  tfc  =  to  +  kAt,  k  £  I(—r,  N)}, 

=  {4_1  :  4"1  =  Tt-t  +  kAt,  k  £  7(-ri_1,  JVi_i)}, 


(9.28) 


where  At  =  =  4v.Tli  1  ^0  =  to- 


Remark  25  We  define  S,  =  Aj_i  with  5o  =  0.  For  77  f  0,  we  note  that  we  can  write  P  as 

1=0 

{to  <t\<  ...  <  t.N0  <  tjVo+1  <  ••••  <  tjVo+Ai  <  t7V0+AT1  +  i  <  ....  <  tsi_1  <  tSf-i+l  <  •••  < 

t^  <  ...  <  T}.  From  this,  it  follows  directly  that  the  jump  times  T*  arc  contained  in  P.  For  any 

d—  1 


t{,  1  £  P*  7  £  [0,  we  have  fk  1  £  P.  Hence,  there  is  a  relationship  between  elements  of 

3)7—1 


with  P  that  is  described  by  t\  1  =  ts,  ,+/.•-  for  k  £  7(0,  Ay).  In  fact,  the  relationship  between 
set  of  jump  times  {Tj,  X2, ...,  Tk}  and  the  partition  P  defined  in  (9.28)  is  as:  7)  ->  t^.,  where  the 
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Nj_ i’s  arc  the  size  of  partition  Pi-1  of  the  sub-interval  [T)_i ,  Tfi.  It  follows  that  Sk*  =  N.  Using 
these  facts,  and  noting  that  if  I\  =  0,  then  P*”1  =  P,  JVj_i  =  N,  Tj_i  =  r,  7,-1  =  7,  j-j_i  =  r, 
r/i_  1  =  77,  fU 1  =  f/,:.  Moreover,  (9.28)  can  be  written  as: 

r_1  =  I4'1  :  4_1  =  T*-i  +  k  €  JVi_r)}  •  (9.29) 

For  each  i  €  / ( 1 .  K* ) ,  let  {x*_1  ( 1 ) } ^=-r  be  a  finite  sequence  corresponding  to  the  stochas¬ 
tic  process  x  and  partition  Pl_  1  defined  in  (9.29).  We  simply  write  =  x*~’  (f>7 1  )•  We  further 

recall  that  x(f^._1)  is  Fa-  1  measurable  for  k  €  /(  —  r,_i ,  iVj_i).  We  also  recall  the  definition  of  for- 
ward  time  shift  operator  F  [1 1]  : 


Fix(4-1)=x(4-+1,),  (€/(0,oo). 


(9.30) 


Definition  9.5.2  For  1  =  1  and  1  >  1,  eac/r  k  €  I  ( 0,  and  each  mlk  1  €  7(2,  rj_i  + 

<Si_i  +  A:  —  1),  a  partition  PT~ 1  of  closed  interval  [fl_1  ,  fU1,  ]  is  called  local  at  time  fl_1,  anri 

K 

it  is  defined  by 


k-v 


Moreover,  Pk  1  is  referred  as  the  mf  1  —point  sub-partition  of  the  partition  P'  1  in  (9.29)  of  the 


pi—  1 +i—  1  ^  ji—  1  ^  ^  j.*—  1 

^  —  Vm*"1  <  Vm^+l  <  <  r 

2 —  1 


(9.31) 


i2 —  1 


closed  sub-interval  [tl  1  j_i,  f^-i]  of  [— Tj-i,  Tj], 


2—1  ' 


k—m 


Remark  26  We  note  that  for  K  =  0,  that  is,  there  is  no  jump,  we  have  Pk  1  =  P/,.,  m2k  1  =  m^, 
f'F 1  =  tl]f}mk,  and  =  ifc-i,  where  Pj~  is  referred  as  the  m/,.— point  sub-partition  of  the 


k—m ] 


partition  P  in  (9.28)  of  the  closed  sub-interval  [tk-mk,  tk]  °f  [2o  —  F  T]  for  k  F  7(0,  N). 


Definition  9.5.3  Foreachi  €  1(1,  I<*),  k  €  1(0,  Wj_i)  and mjf1  <E  7(2, 77-1  +5j_i  +  k  -  1), 
fl  local  finite  sequence  at  tlkl  of  the  size  m^-1  is  restriction  [2]  of  {x(tlkl)}k^r}r  . _  to  PJT1  in 

(9.31).  This  restriction  sequence  is  defined  by 


*1T\*  := 


+1 


(9.32) 


As  ml  1  varies  from  2  to  77-1  +  <Sj_i  +  k  —  1,  the  corresponding  respective  local  sequence  Si- 1  , 

nk  ’ 

a?  f^T1  varies  from  {x(tll~1)}^Zk_2  to  {jc(f^_1)}^r^r.  +<s.  +1.  As  a  result  of  this,  the  sequence 
defined  in  (9.32)  is  also  called  a  mlk1-local  moving  sequence.  Furthermore,  the  average  corre¬ 
sponding  to  the  local  sequence  S  ,  1  ,  in  (9.32)  is  defined  by 


(9.33) 


The  average/mean  defined  in  (9.33)  is  a/so  called  the  ml  1-local  average/mean. 
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For  i  G  1(1,  K*),  and  k  6  1(0,  iVj_ i),  the  mlk  1-local  covariance  matrix  coiTesponding  to  the  local 


sequence  Sm»-i  k  in  (9.32)  is  defined  by 

1 

t  hi 

(  s  i- i  . 
m,  ,k 
k  ’ 

1,2 

1,3 

^  mf1  ,k 

l,n  \ 

mfc 

M 

*7 

V 

ii 

2,1 

Sml~1,k 

k  ’ 

2,2 

Smi~1,k 

2,3 

^  mf1  ,k 

2  ,n 

(9.34) 

n,l 

n,  2 

1,fe 

n,  3 

n,n 

where  s^t_l  k  =  ^-ik(x),jfi  €  1(1,  n) 

is  the  local  sample  covariance  statistic  between 

Xj  and 

xi  at  t',.  1  described  by 


j,l 

Sm{-\k 


■  =  < 


0  /  0 
ri-1  \  1 


E  --hr  E  I  X 


‘'fc  i  —  1  ,  i 

a=—m,  +1 


k  i  i  —  1  i  i 

b=-m.  +1 


1 


Faxi(t\_ t)-^  E  ^(4-t)  h  for  small 

^  "  6=-"*r1+1  / 

rirrj  E  J=t  E  r*^(C‘i)|x 


E  ^(4-i)  >  for  large  m; 


k  7  i  —  1  ,  -i 

b=-m.  +1 


i— 1 
/c 


(9.35) 


In  the  following,  we  derive  a  interconnected  discrete-time  local  conditional  sample  average/mean 
and  covariance  dynamic  processes.  This  fundamental  result  is  motivated  by  Exercise  5.15  in  [14]. 
Denoting  x(k)  =  x(fl_1)  for  i  G  1(1,  K*)  and  k  G  we  state  and  prove  the  following 

Lemma. 


DEFINITION  9.5.4  Let  {E [xj(tt  +1  be  a  conditional  random  sample  ofcontinu- 

ous  time  stochastic  dynamic  process  with  respect  to  sub-o  algebra  Tp- 1 ,  tfi  1  G  P*_1  in  (9.29).  The 
ml- 1  -local  conditional  moving  average  and  covariance  defined  in  the  context  of  (9.33)  and  (9.34) 
are  called  the  m^-local  conditional  moving  sample  average/mean  and  local  conditional  moving 
sample  variance,  respectively. 


Lemma  9.3  ( Multivariate  Discrete  Time  Dynamic  Model  of  Local  Sample  Mean  and  Sample 
Covariance  Process).  Let  {E [xj(flfi~1)\Jrti-i  1+i  be  a  conditional  random  sample  defined 

in  Definition  (9.5.4).  Let  S  <- 1  ,  and  Y]  i  ,  be  ml- 1  -local  conditional  sample  average  and  local 

TTt  i  ,  rC  *  ■*  ITl  i  ,  rC  rC 
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conditional  sample  covariance  at  zl  1.  Then,  an  interconnected  multivariate  discrete  time  dynamic 
model  of  local  conditional  sample  mean  and  sample  covariance  statistics  is  described  by 


Si-1 


lk-di_1+ 1 


,k—di— i+l 


Eml  1tk 


lfe-di_1+ 1 


=  < 


di — i 

i  — 1 

E 

m, 

k—j 

j  —  1  1 

i=i 

n 

_  z=o 

+  - 


n  m‘11. 


-S  i-1 

TTb  j  , 


1-,k—j 

fc-j’  ^ 


i-1 


,k—di-i  m 


,k—dj. 


+  £m*- 


for  small  m!k  1 ,  mjdi  <  1 


di-i 

E 

i=l 

+ 


m 


m"1-1 

k—J 

j-1  .  . 

n  <1 

z=o 

l—i 


1,fc— 

«— j  ’ 


k  —  d. 


i— 1 


di_i~i  m 

n 

1=0 


c< 

■l-rf-  ,k-di-im)-\.  ,k—di-i 


+emi-_\,k-vf°rlarSernk  mk- 1  ^ 

E^.-1  j  =  Ej.  *  £  /(1,-fC*),  j  £  /(— di_i,0),  initial  conditions 

(9.36) 


E— 1 


m  * 


where 


V 


( rA 


\nnJ 


/  1,1 

mf~7,k 

1,2 

emi~1,k 
k  ’ 

e1’3 

dr1,*  ■ 

l,n  \ 

•  •  ^  ;_i  , 

mfc 

J>fc 

2,1 

mf1,}; 

2,2 

^ral- 1  ,k 

£2’3 

mj.-1,*:  ‘ 

2  ,n 

"  £mik1,k 

n,  1 

\  mf~1,k 

n,2 

Smi-\k 

n,  3 

£mi~1,k  ' 

n,n 

"  £m[r\kj 
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emi~1,k 
k  ’ 

1,2 

1,3 

fc  ’ 

l,n  \ 

•  e  i-l  , 
mfc 

(Ti 

**r 

V 

II 

2,1 

m!— 1,fe 

2,2 

emzfc“1,fc 

2,3 

emf  S*:  ’  ' 

fc  ’ 

2  ,n 

'  erre^_1,fe 

n,l 

n,  2 

n,3 

em{-i,k  ’  ' 

fc  ’ 

n,n 

‘  em[-\kJ 
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7 

Vi- 1 


,k—di- 1 


1 

7i_1 

k-dj-1+1 

i-l 


— m\  ,  +1 


E  Fixj{k  —  di~i) 

L=-mr_1d._  i+i+i 


_ p1  k  —  d. 


'i~1Xj(k  -  di- i)  +  F°Xj(k  -  di-i) 


eF 

"Cl.*-1 


< 1  - 1 


m 


2—1 


g  jr-t+ig^fc  -  1  )F~L+1Xl(k  -  1) 


l-l 


1=1 


a=0 


n  rrik-_\ 


di~ 1  F~l+1-<-'Xj(k  -  i )F-L+l~<-‘Xi(k  -  1) 


E 

i=i 


t-i 


n  mj- 


a=0 


2—1 

k—a 


di- 1  p—b+2—mL  1 


E 

t=i 


k~‘-Xj(k  -  i)F_t+2_m*-‘®j(A;  -  1) 


t-i 


n  K- 


a=0 


2—1 

k—a 


+ 


K  1  - 1 


rn. 


A—  1 


di-l 

E 

i=i 


„2— 1 
k  —  L 

2-1 
fc  — t+1 


— 2+2— 

£  F%(fc-l)F^(A:-l) 

t;=— 2+2— rri 


2-1 


n  mjrJ 


a=0 


2—1 

k—a 


di- 1 


+E 

2—  1 


—  2+1 

E 

V,S=  —  2+2  —  772 
V^S 


FvXj(k  —  1  )Fsxi(k  —  1) 


k  —  2+1 


i-i 


n  mr 


a= 0 


2—1 

k—a 


i 


m 


o 

i-i  E 

v,s=-mt~1  + 1 

V^S 


Fvxj{k-l)Fsxl(k-l), 


(9.37) 
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J’1 


F~i+lXj(k  -  l)F~i+1xi(k  -  1) 


t- 1 


i=i 


a= 0 


n  K-a 


di~1  p~i-+ 


E 

u=i 

di~i 

E 

1=1 


k~LXj(k  -  1  )F~u+l~mk^xi{k  -  1) 


t-i 


n  <-_J 


a=0 


i— 1 
k—a 


F-L^-mk_ix^k  _  ^ 


t-1 

n 

a=0 


n  K7_\ 


i 


0 


i_t  ,  E  F°Xj(k-l)F‘x,(k-l) 
m *  -1 

V^S 


di- 1 

+  E 

6=1 


— 6+2— m? 


£  F%(7-1)FE+A:-1) 


■u=— 6+2— m 


fc— t+i 


t-i 


n  ml- 


a= 0 


i—  1 
k—a 


di- 1 

+  E 
6=1 


~6+l 

£  FvXj(k-  l)FsXl{k-  1) 

v,s=-i+2-ml-_\+1 

V^S 


6-1 


FI  rni_ 


a= 0 


i—  1 
k—a 


9.6  Parametric  Estimation 


In  this  section,  we  consider  a  parameter  estimation  problem  in  drift  and  diffusion  coefficients 
of  (9.23).  This  is  achieved  by  utilizing  the  lagged  adaptive  process  [88]  and  the  interconnected 
discrete-time  dynamics  of  local  sample  mean  and  variances  statistic  processes  model  in  Section  9.5 
(Lemma  9.3).  For  each  i  G  7(1,  77*),  we  consider  a  general  interconnected  hybrid  system  described 
by  the  system  of  stochastic  differential  equations: 


dxl  1 
x* 


f -1(f,x)df  +  +-1(f,x)dW(+  x(Ti_!)  =xi"\  t  G  [T,_!,  T,;), 

rv-1(?r+-i+-1), 


(9.38) 


where  Tl  =  diag(rj,  r|, T*-, ...,  TjJ  is  the  jump  coefficient  matrix;  the  jump  times  7)’s  arc 
defined  in  (9.23).  For  each  j  G  7(1,  n ),  the  estimate  of  the  jump  coefficient  F)  is  given  by  F)  = 

_ Xj(Tj) _ 

lim  xz~1(t,Ti_1,%i~1) ' 
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Let  V  €  C*[[— r,  oo]  x  and  its  partial  derivatives  V),  ^  and  d~,'r'L,  1  exist  and  are 


continuous  on  each  interval  [Tj_i,  T,\.  We  apply  Ito-Doob  stochastic  differential  formula  [70]  to  V, 
and  we  obtain 

I  dV(t,xi~1)  =  L V(t,xi-1)dt  +  Vx(t,xi-1)a(t,xi-1)dW(t),x(Ti_1)=xi-1, 

\  Vpi,*)  =  V (Ti ,  T V-1  (Tr ,  T;_i ,  x*"1 ))  ■ 

(9.39) 

where  the  L  operator  is  defined  by 


hV (t,  x*_1) 
c(f,xi"1) 


Vt(t,xl  1)  +  VX (f,x*  1)/(t,x*  4  +  \tr(Vxx(t,xl  1))c(t,x*  *) 

X*_1)<T*_1(f,  X*_1)T. 


(9.40) 


For  (9.38)  and  (9.39),  we  present  the  Euler-type  discretization  scheme  [58]: 


Ax*"1^-1) 

=  dCDX1 

+^~ 1  (4l\ ,  x(4-\ ) ) AW (4“ 1 ) ,  k  G  /(1,^-r) 

X* 

AF(4-1,x*-1(f 

r1))  =  ^(C1i>^1(4-i))a4“1 

+k(4a\  ,  x*-1  (4i\))o-*-1  (4i\,  x(4i\))  aw  (4~ 

V {Ti,  x*) 

=  F(Ti ,  r  V” 1  (Ti- ,  T,_ ! ,  X*- 1 ) ) . 

(9.41) 


Define  ^  =  Tt1 


,7]  as  the  filtration  process  up  to  time  t'k  .  With  regard  to  the  continuous  time 
dynamic  system  (9.38)  and  its  transformed  system  (9.39),  the  more  general  moments  of  A x(t 
arc  as  follows: 


i— In 

k  > 


e  [Mtj-'lUt1,] 

E  [(Ax‘-i(4-‘)  -  E  [Ax‘-1(4-1)|r-;11]) 

(AV-ytr1)  -  E  [Ax<-'(4-1)«:;])Ti4:1, 


l  £[AV(4-1,xi-1(4-1))|^*;11] 


=  r_1(471,v-1(44))A4-1, 


=  <ri-1(tti.x‘-1(44,))x 

vi-l(+i-l\\T \+i-\ 
k  5 


=  LV^x^if-1),)  At 


ji— 1 


(9.42) 

E  [(AF(4-1,x<-1(4-1))  -  E  [AV(4-1,xi-1(4-1))|^;I1]) 

(Av(4-1,xi-i(4-'))-£[AF(4-1,xi->(4-1))|jj:i])Tirt;11]  =  b(4"_1,.v-1(4-1)) 

(9.43) 

where  B(4'l11,x(4I11))  =  V, ,  c  (4l\,  x(4L\))  K  (4-i,*(4-i))T  A4"\  anti 

T  stands  for  the  transpose  of  the  matrix. 
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From  (9.41)-  (9.43),  we  have 


'  Ax-44-1)  =  E[^-\e-')\rkz\] 

+V1-1  (4-1!  ’ xi_  1  (4-\ ) ) A w (4“ 1 ) ,  ke  1(1, Ni.fi 

AF(4-1,x-1(4-1))  =  E[AV(ti-\xi-\ti~1))\jtJ1\ 

(4-\ » x"-1  (4-\  ))^-x  (4-\ » 

(9.44) 

This  provides  the  basis  for  the  development  of  the  concept  of  lagged  adaptive  expectation  process 
[88]  with  respect  to  continuous  time  stochastic  dynamic  system  (9.39).  This  indeed  leads  to  a 
formulation  of  mk  1  -local  generalized  method  of  moments  at  t\  1 . 

In  the  following,  we  state  a  result  that  exhibits  the  existence  of  solution  of  system  of  non  linear 
equations.  For  the  sake  of  easy  reference,  we  shall  re-state  the  Implicit  function  theorem  without 
proof. 

Theorem  9.1  Implicit  Function  Theorem  [2]  Let  F  =  { I?\ .  F->, ....  Fq)  be  a  vector-valued  func¬ 
tion  defined  on  an  open  set  S  £  R.q+k  with  values  in  M9.  Suppose  F  £  C\  on  S.  Let  (uq;vo)  be 
a  point  in  S  for  which  F(uq ;  Vo)  =  0  and  for  which  the  q  X  q  determinant  of  the  Jacobian  matrix 
det  [JF(v0)]  fi  0.  Then  there  exists  a  k—  dimensional  open  set  To  containing  Vo  and  unique  vector¬ 
valued  function  g,  defined  on  To  and  having  values  in  M9,  such  that  g  £  C\  on  Tq,  g(vo)  =  Uq,  and 
F{g(v)',v)  =  0  for  every  v  £  To- 

9.6.1  Illustration: 

For  each  j,  l  £  1(1,  n)  and  each  i  £  7(1,  K*),  we  consider  a  special  case  of  (9.12). 


dy.j 

yj 

dp  fit) 

.  PJ 


<  1  -  Vj 


'j.j'iii  +  yifi.i'v 


dt  +  sj7j  R  -  yj)  dwJjW 


+  (R1  -  Vj)  E/fii'mdWjfit),  Vj  (Ti.fi  =  yfifi  t  £  Tj), 


ir 


Pj 


^(yj-pfi  +  Pp l  +  E7]>4) 


(9.45) 


dt  +  o-jj  pjdZjj(t) 


+Pj  E  a)  1 1PldZj,i(t)i  pj (Ti.fi  =p)  \  t  £  [Tj_i,Tj), 


i—  1 


3 

e)p)~l  (T- 
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Here,  k*  / 1 ,  it!'-  1 ,  ff-  1 ,  7®.  1 1 ,  ;  1 ,  <7*  1 1  arc  the  system  parameters  on  the  j  ump  subinterval  [Tj_  1 ,  T,; ) ; 

n-1,  At*”1 ,  7*”1,  (5’g1  and  at*^1  are  positive;  and  for  l  /  j,  G  M;  <5]y\  ct'J1  are 

nonnegative,  FF  and  Z  arc  independent  standard  Wiener  process  on  a  filtered  probability  space 
(O,  J7,  (F)t>o,  P)  with  the  properties  described  in  (9.12).  It  follows  that  the  interconnected  system 
of  stochastic  differential  equations  (9.45)  has  4 n2  +  2 n  parameters,  Also, 


2—1 

1# 


and  likewise, 


Fwtfo1  1 


>  0  if  y/  is  cooperating  with  tjj , 

<  0  i  f  yi  is  competing  with  y3 , 

=  0  if  there  is  no  interaction  between  m  and  y3 ,  j,  l  G  1(1,  n), 


>  0  if  pi  is  cooperating  with  pj , 

<  0  if  p;  is  competing  with  pj , 

=  0  if  there  is  no  interaction  between  pi  and  77 .  j,  l  G  1(1,  n). 


Remark  27  For  the  case  K  =  0,  (9.45)  reduce  to 


dyj  =  ( u-j  -  yj) 


dt  +  Sjj  ( Uj  -  yj)  dWjj  (t) 


Kjjyj  +  E  Kj,wi 

n 

+  (uj  ~  dj)  E  Sj,iyidWjti(t),  yj  (f0)  =  yjo,  t  G  [t0,  T], 


dPj(t )  =  pj  ij,j(yj-Pj)  +  Pj  +  J2ij,iPi(t) 

¥j 

n 

+Pj  E  aj,iPidzj,i{ t)>  p?  (*o)  =  P?o,  t  e  [to,  r], 
¥j 


dt  +  <TjjPjdZjj(t) 


(9.46) 


(9.47) 


(9.48) 


where  for  j,  l  G  7(1,  n),  the  parameters  n;jj,  Uj,  f3j,  77/,  8jj  and  07/  arc  the  system  parameters  on 
the  interval  [to,  T];  Uj,  Kjj,  7 jj,  5jj  and  077  are  positive;  and  for  l  /  j,  Kj^u'Yjj,  G  M;  <5^,  <77;  arc 
nonnegative. 


For  each  j  G  7(1,  n),  we  pick  a  Lyapunov  function 

Vi  j{t,yj)  ~- 

V2  j{t,Pj)  ~- 


(yPq 


j  >  > 

3)  > 


(pPq 


(9.49) 
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in  (9.39)  for  (9.45).  Using  Ito-differential  formula  [70],  we  have 


dVij  = 


V1 

v2j 


q(yj)q  -yj)  K-,i  yj  +  S«},z  yi 


1  )(yjr'{u'r-yj)  +g(Vj  yf 


+q(yj)q  1  K-  1  -yj 


Sl^dWj,j(t)  +  Y,^yldWhl{t) 

i¥=i 


Uj  (Ti— i)  —  Uj  i  i  G  [Ti-i,Ti) 


ViJ 


dV2i  = 


3 

(PjE 


}  yj{Tr,Ti_uyi-1)q ,  if  t  =  Ti 


q  i)  ( yj  -  pj )  +  $  +  £  7],/  pi 

\  Uj  t 


77 


dt 


+q{Pj)q 


dZjA*)  +  52  aj,i  PldZj,i{t) 
Ui 


dt 


Pj  (7i_i)  =p)  ,  t  G  [Tj_i,Tj), 


=  ^  Pj  (2;-,r<_1,y<-1,pi-1),J  iff  =  Ti 


(9.50) 

By  setting  At*"1  =  f-1  -  C\  =  At;  Ay(4"1)  =  y^"1)  -  yff^)  and  Ap(4"1)  =  p(4"1)  - 
p(f-\),  the  combined  Euler  discretized  scheme  for  (9.50)  is 


A^m-1)  = 


V?-1  rp-1  j  ( n*_1 


j  -  2/j(Ci) J  I  ^-  yj-^-i)  +  E  ^ } j 1  yi (4—t ) 

Uj  / 


+29(7  -  i)  ( yj)q  "  (4-t) \u)  ~  yj(fk- 1 

2 


ri— 1 

}jj 


+Efe‘) 

Uj  v  y  , 

u-t  tP-1  'i  E*-1 


At 


+9  w1  (C-i)  K  -  %(cAi)  K;  ^-(r) 


+E«;-71wAwili(trl) 

Uj 


Vj  (T^)  =  yf1,  f*-1  G  [Ti-r.Ti), 


:\9 


=  TP 


y}-1  if  t  =  Tj . 


(9.51) 
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q  Tfi'iyji -  pM-i))  +  f?r  +  £  WrttV. i) 
V  ) 


AfeOMtf1)  =  fe)’(4-i) 

+i*«  -  » I  («J5*)* + £  fa1)  V«fc‘.> 

^3 


At 


+q(Pj)q(ti-_\) 


r&AZjjit'k)  +  £ 

»# 


Pj{Ti-i)=p)  t\  <E  [Tj_i,Tj),  q  <E  /(l,n+  1), 

=  ifi  =  T<. 

(9.52) 

where  {y(^-1)}°=_r. _j5  {p(^_1)}^=_r,_i  are  given  finite  sequence  of  measurable  ran¬ 

dom  vectors,  and  are  independent  of  {AW^^”1)}^1,  {AZ (tlk~1)}^A01 ,  respectively.  We  define 

a  (yj)9  (4_1)  =  (yj)q  (4_1)  -  (yj)9  (4-i ) and  A  W  (4"  4  =  (ps)9  (fir1)  -  C Vi)9  (4-\)- 

Applying  conditional  expectations  to  (9.51)-(9.52)  with  respect  to  J~l~  1  =  we  obtain 


-jferhc'i 


i— 1 


U- 


-  w(Ci)J  Ky«(4-i>  +  E 


+TSJT  W"2  (C'llE  [(A</j(4_1)  -  EIA^K-'IK-;])2  l^ll 

for  t‘-‘  6  [Ti_,,Ti), 

B  [(«$)’ wbbufcil  =  (*jY  M’  (Tr^-uf-1) ,  *  i-' =Tt. 


E[A(J.j)«(4-1)i^:11]  = 

o  (Pif  (4-\)  fiS’wt1,)  -  w<«fc\» + /r 1 + £ 

V 


At 


(9.53) 


[(A»(4r‘)  -  ElAp^ti-1)!^!1,])2 1 Jt-\ 

for  4"1  €  [Ti-^Ti), 


At , 


E 


=  fe)  (Pj)q  ,  if  4-1  =Ti,  q  €  I(l,n  +  1), 


(9.54) 


E  [(A  (Vjy  (tjr1)  -  E[A  (y,)«  (4“1)l*7fc-i])  X 

(A  fa)9  (4_1)  -  E[A  ( yi)q  \H-W  = 


v2  (yjvi)q  1(4-\)(^  1  -  %(4-1i) j  K  1-t/z(4-\)) 


+47^4/K4-i)+  £  CTW*-1!) 

r=lj,/^r 


(9.55) 


At, 


[  4  1  G  [Ti_i  -ri_i,Ti), 
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E  [(A  fefe  (4-1)  -  E[A  C pj)q  (4_1)l*7fc-1i])  X 

(A  fe)9  (4_1)  -  E[A  (p,)«  (4“1)l^ii])  l-nzi]  = 

?2  few)9  (4-i 

_  j^l,q£  /(l,2n) 

where  fefe  is  the  filtration  up  to  time  fjfe .  From  (9.53)-(9.56),  (9.51)  reduces  to 


r=l,j,l^r 


(9.56) 


a  fern-1) 


< 


a  fern-1) 


E[Afe)fe4-1)|fel11] 

+« (nr1  («ti)  (»r‘  -  w(4-i))  fer-'An^r1) 


+  E4r1mAwj,i(4-') 

(^)\yj)q  fe-,Ti-1,yi-1),if4"1  =  ^ 
E[Afe)fe4-1)|fe:11] 


,  fe_!)  =  y}-1,  ifeG  [Ti-i.Ti), 


+9fem-i) 


^jAfe',44"1)  +  E 


W'fe-i)=p}  ,4  G  [T,_i,  T,;),  q  e  I(l,n  +  1),  j  €  1(1,  n), 


fe)  fe)9  ,  if  fe1  =  Ti 


(9.57) 


(9.57)  provides  the  basis  for  the  development  of  the  concept  of  lagged  adaptive  expectation  pro¬ 
cess  [88]  with  respect  to  continuous  time  stochastic  dynamic  systems  (9.45)  and  (9.50). 

For  k  e  1(0,  Ni-i),  applying  the  lagged  adaptive  expectation  process  [88],  from  Definitions 
9.5.1  —  9.5.3,  and  using  (9.53)-(9.57),  we  formulate  a  local  observation/measurement  process  at 
4_1  as  a  algebraic  functions  of  mV  1  -local  functions  of  restriction  of  the  finite  sample  sequence 
{y(fe')}tfe,  and  {P(4_1)}f=-ri_i  to  subpartition  Pjr1  in  Definition  9.5.2  : 
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k- 1 


E  E[A(w)«(r1)K:i1]  = 

t=k—m) 


C1 


fc-i 


e  « tercel 


i=k—m1 


,i—  1 


U- 


-yj(t\_\)  \  x 


3,3 


+^(wrz  («)<£!-> 


fc-i 


e  E[A(Pi)«(r1)i^ii1]  = 


L=k—m\ 


k- 1 


^9-2 

mj.  L,k,Ayj 
\9  f-.i-l 


At, 


E_  </ta(Ci)  7]jtaCi)taCi)) 


L=k—mV 


+P}  +  E 


¥ 3 


2  At  Pj  t-  l)  m*  1,k,Apj 


At,  q  G  7(1,  n  +  1), 
(9.58) 


and 


fc-l 


e  92  tar1  (cl 


i=k—m , 


.i—1 


.i—1 


Uj 


-  ))  x 


Ww(C!)  +  ^‘*(«)  +  E  ^VIG) 

r=l 

E  92  ta)9  (Cl)  teMjS(Cl)  +  ^J^&VKCl) 


1 ,—k—m, 


A— l_i— l„2/'+i— 1\ 
3"~  E/  ®jj  r  PrV'L—  l) 

r=l 

j¥=l¥=r 


,  j  +  l,  q  e  7(1, 2?z). 


(9.59) 


For  each  i  G  7(1,  77*)  and  each  j  ^  t  G  7(1,  n),  we  define 

Flq  (u}-1,  {r1}’^)  -  *i,  (e  [a  (yj)  (tr1) Ita]  ;vf\  {r1}^) , 

F29  (e  [a  (yj)  (C1)!^!1]  ,E  [a^)^-1)^!1]  ;  {C'.C1}^) 
Gi,  (e  [a  [p])  (r^ita]  rr  {r1}^) 
g2,  (e  [a  {p))  (trEirr]  ,e  [a  (pf)  (c1)!  ta] ;  {^ta1}^)  - 


Gi9(ri>{7r}’,=1) 
Ga,  (joTr1  }t=1) 


by 


138 


For  every  j  e  1(1,  n),  we  have 


f  M-Fl 

L) 

=  0, 

q 

6 

7(1, n+  1), 

Mi 

fji-t 
?,r  ’ 

\) 

=  0, 

q 

e 

7(1, 2n), 

•y’ 

r  i 

'\n  \ 

(9.61) 

Gi,  (, 

1 

3  ’ 

{y. 

}J 

=  0, 

q 

G 

7(1,  n  +  1), 

.  M 

f  ri-l 
[  ’ 

c1} 

“ ) 
t=i/ 

=  0, 

q 

G 

7(1,  2n). 

Let  us  define  F,  =  {Fi J9e7(1>n+1),  F2  =  {F2 J?e/(1,2n),  Gi  =  {GiJ9ej(iin+i),  and  G2  = 
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Thus,  provided  that  the  determinant  of  each  of  the  Jacobian  matrices  JF\  I  u 


,i— 1 
j  ’ 

n 


JF>  H  '•  JGi  {^D and  JG2 


j’c  ;t =J’ 


arc  not  zero, 


by  the  application  of  Theorem  9.1  (Implicit  Function  Theorem),  we  conclude  that  for  every  non¬ 
constant  mp1- local  sequence  ^i_1  and  {/^(tp1)}^1  mi_i,  there  exist  a  unique 


4.2— l\p  fc— 1 

W=fc-mJ; 

solution  (uppmp1,^1),  fp1),  {ppptPmp1,  fp1),  {'yp1}pi(mpp fp1), 

(<5p1}Pt(mp1,fp1),  {(jp1}pi(mp1,  fp1))  of  system  of  algebraic  equations  (9.63)  as  a  point 
estimates  of  up1,  {rep1}^,  {7p1}^=1,  {(5p'}”=l,  {op’}Pi,  j  G  1(1,  n),  respectively.  In  the 
next  section,  illustrating  this  approach  using  energy  commodities  natural  gas,  crude  oil  and  coal 
[26,  27,  28],  we  show  conditions  in  which  the  determinant  of  the  Jacobian  matrix  is  not  zero. 


9.6.2  Illustration:  Application  to  Energy  Commodity 

In  this  subsection,  we  present  an  illustration  regarding  the  natural  gas,  crude  oil  and  coal  [26, 27,  28]. 
Here,  j  G  7(1,  3)  and  i  G  7(1,  K*).  Moreover,  (9.45)  reduces  to 


dy.j 


=  i ;  Hi 


vj  +  E  vi 


<11  +  pp  UpJ  -  Vj)  dwjd(t ) 


+  (  p_1  -  Vj)  E  S^mdWj^t),  yj  (T,_!)  =  yp\  t  G  [?)_!,  7)), 
7  i¥=i 


=  ^yj(Tr,Ti- 1,?-1), 


dpj(t)  =  Vj 


dt  +  Vj^PjdZjj  (t) 


7 JJ  ( Vj  ~Pj)  +  Fj  +  E  7 h  Pl(t )  | 

+Pj  E  v^PldZjjit),  Pj(Ti-i)  =p]~1,  t  G  [Tj_i,Tj), 
p  =  0)Pj  {T- . 

For  each  j  G  7(1,  3),  following  the  argument  used  in  Illustration  9.6.1,  we  have 

1 


F.»  I  u'r 


k- 1 


m 


(9.62) 


s(w)9-1(Ci)(«r -w(Ci))x 


+ 


^  E 

^  t =k—iri‘k  1 

^«j,ryt(Ci)l 

<t=i  / 


At 
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k-1 


F- 


2  q 


({M‘L 


m 


k  E  E[A  (^(C1)!^:!1],  ?€J(1,4), 

k  t=k—mx~1 
k—1 

pt  E  q2  ( ym ),_1  (Cl)  (E1  _  %-(Ci))  x 


i 

JL— 

k  i= k-mi -1 

k 


W  1  -  w(Ci))  +  sb 


+  E  JfcVfcVttl) 


r=l 


-  (A  fe)8)’ 
A:  ’  5 


Gi 


7(1,3),  <?  g  /(i,6) 

A;— 1 

pt  E  { [?  fo)9  (Ci)  ('Vjj1(yj( Ci)  -  Pi(Ci)) 


m 


1 

„i— i 

k  t= k-mi -1 

k 


+P}  1  +  E  7?',t  1^t  (C 1 ) 

t# 

^(^  —  l)„,g-2/.i-l\SA7 


+ 


2At  ^ 

fc-i 


■pp (Ci)o-i  ,(APi) 


At 


■Aj  E  E[A(Pj),(C1)K:,1],  «  6/(1, 4), 

Tfll,  . 


^  i=k—mlk  1 
fc-1 


=  E  ?2(PiPi)9(cl) [4/</p^ci) 


L=k—m 


+<7i)i1°‘})i1pt(ci)+  E  ^App^cl) 


t=i 


d,i 


I?  G  7(1,6). 


and  for  j  ^  l  €  1(1,  3),  we  have 

f1<?E;-1,{k;-1}'=J  =  o,  «  g /(i,4), 

^({^1,p}'=J  =  0,  q  €  7(1,6), 


Gi*(#  ,)  =  °>  9  e  7(1,4), 

=  °’  9  €1(1,6). 


(9.63) 


We  also  F\  =  {i?ig}ge/(i,4),  7b  =  {72q}ge/(i,3)>  G\  =  {G ig}qe/(i,4)>  and  ^2  =  {G^jge/pa)- 
Thus,  for  each  j  G  7(1, 3),  the  determinant  of  the  Jacobian  matrix  JPj  P-1,  j  k*"1  |  j  is  given 
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by 


r  det 


(-r1)4 

(  E  l/t(Cl 


fc-1 

£  ^ 


L=k—m\ 


where  ^  is  define  by  ^  = 


{Uj  - 


(uj  -  yj(tl_{))y2(tl_\) 


{uj  -  Vj(tl_l))y3(tl_l)  \ 


2  E  «j,ryt(Ci)w(Ci)  2K  -  2/j(Ci))w(*!-i)yi(Ci)  2(“i  -  %'(Ci))w(Ci)2/2(^_i)  2K  -  yj(tl-i))yj{t[-i)y3(tl-i) 

C=1 
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i^4  E  Kj,t2Ar(Ci)^(Ci)  4K  -  %(Ci))y| (Ci)yi(Ci)  4(“j  -  w(Ci))yf(Ci)»2(Ci)  4K  -  %(Ci))yf  (CiMCi) J 
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For  j  R  l,  the  determinant  of  the  Jacobians  JF2  ^ j  Sl~. 1 .  cR 1  j  ^  ,  JG\  ^/3*-1,  j7'*- 1 j  ^ 
and  JG2  ^{cr*-1,R-1}  ^  can  be  derived  in  a  similar  way.  For  each  j  £  7(1,  3),  it  follows  that 

the  determinant  of  JFi  fix*-1,  |  kR  1 1  ^  is  not  zero  provided  that  all  parameters  -Rj,t}y=1  are 

not  zero  or  provided  the  sequence  j  y*-1  (t*-1)  | 


fc-i 


7fl(“i'R‘L) is 


this,  suppose  that  the  determinant  of 
one  of  the  following; 

•  The  rows  of  the  matrix  are  dependent  vectors  in  M4, 

•  The  columns  of  the  matrix  arc  dependent  vectors  in  M4. 

•  Either  one  of  the  rows  or  columns  of  the  matrix  is  a  zero  vector. 


is  neither  zero  nor  constant.  To  show 
zero.  This  is  equivalent  to  either 


This  is  equivalent  to  saying  either  all  parameters  Rj.RR  are  zero,  or  the  sequence 

(  'i  k—1 

\  y]~  1  ft*-1)  >  is  zero  or  a  constant. 

V3  Vr  J  G=k-ml~ *-i 

Likewise,  determinants  of  the  Jacobians  JF2  ^ix*-1,  jc>*-1,  R1  j  V 

JGi  f/3*-1,  {7*-1|  and  JG2  are  non-zero  if 

{SjjX,  RjR,  {7j,r}j=1  and  {rrJS,  nyr}4=|  are  not  zero  or  provided  the  sequence 

R1  (go  bt1  to  is.*-.-,.  R1  «-*)  }R„  -  - 

K 

{pR1  (t*-1)  }c_fc_mi-i_1  are  neither  zero  nor  constant  for  j  R  l  6  7(1,  3). 


r =k—mth  1  —  1 
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Remark  28  If  the  sample  <  y*  1  ft*  i)  [•  is  a  constant  sequence,  it  follows  from  (9.51) 

l  ■  )  r =k—m]  —  1 


(q=l)  and  the  fact  that  A  [y%.  1(t\  l)  j  =  0  and  s^_i  (A yj)  =  0,  that  ul-  1(mtk  l) 
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R  R)  x/*  1(tf  4).  It  also  follows  from  (9.58)  that  {k*c1}4=1(?R  1 ,  tjf  i)  — >  0. 
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Chapter  10 

Computational  and  Simulation  Algorithms 


10.1  Introduction 

In  this  chapter,  we  outline  computational,  data  organizational  and  simulation  schemes.  We  intro¬ 
duce  the  ideas  of  iterative  data  process  and  data  simulation  time  schedules  in  relation  with  the  real 
time  data  observation/collection  schedule.  For  the  computational  estimation  of  continuous  time 
stochastic  dynamic  system  state  and  parameters,  it  is  essential  to  identify  an  admissible  set  of  local 
conditional  sample  average  and  sample  covariance  parameters,  namely,  the  size  of  local  conditional 
sample  in  the  context  of  a  partition  of  time  interval  [T,_ i  —  77  _  i ,  T,\.  Moreover,  the  discrete  time 
dynamic  model  of  conditional  sample  mean  and  sample  covariance  statistic  processes  in  Section 
9.5  and  the  theoretical  parameter  estimation  scheme  in  Section  9.6  motivates  to  outline  a  computa¬ 
tional  scheme  in  a  systematic  and  coherent  manner.  A  brief  conceptual  computational  scheme  and 
simulation  process  summary  is  described  below: 

10.2  Coordination  of  Data  Observation,  Iterative  Process,  and  Simulation  Schedules: 

Without  loss  of  generality,  we  assume  that  the  real  data  observation/collection  partition  schedules 
P*-1,  i  e  1(1,  K*)  are  defined  in  (9.29).  Now,  we  present  definitions  of  iterative  process  and 
simulation  time  schedule. 

DEFINITION  10.2.1  The  iterative  process  time  schedule  in  relation  with  the  real  data  collection 
schedule  is  defined  by 

{  /P*"1  =  :  for  t*-1  G  P4"1},  fori  €  1(1,  K*),  k  G  N^), 

(10.1) 

where  F~ri~1f^~1  =  tlk l1r._1  is  a  forward  shift  operator  [11]. 

The  simulation  time  is  based  on  the  order  di- \  of  the  time  series  model  of  ml-1  -local  conditional 
sample  mean  and  covariance  processes  in  Lemma  9.3. 
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Remark  29  For  the  case  where  IT  =  0,  we  have  IPj_i  =  IP,  where  P*  1  =  P  is  defined  in 
(9.28).  This  is  the  iterative  time  schedule  in  the  absence  of  jumps. 


DEFINITION  10.2.2  The  simulation  process  time  schedule  in  relation  with  the  real  data  observation 
schedule  is  defined  by 


sr-1  = 


(10.2) 


{pn-if-1  .  for  f-i  €  pi-1},  if  di _!  <  n- 1 

{FPi-Hl1  :  for  t*"1  E  P*"1},  if  >  n-U  k  E  I(-rvi,  A*_i). 

Remark  30  For  each  i  6  1(1,  IT*),  the  initial  times  of  iterative  and  simulation  processes  are  equal 
to  the  real  data  times  4*7^  and  whenever  di- 1  <  rj_i  and  i  >  rj_i,  respectively.  The 
iterative  process  and  simulation  process  times  with  jump  arc  f'j7^r  and  i ,  i  E  1(1,  IT*), 

respectively. 


10.3  Conceptual  Computational  Parameter  Estimation  Scheme 


For  the  conceptual  computational  dynamic  system  parameter  estimation,  we  need  to  introduce  a  few 
concepts  of  local  admissible  sample/data  observation  size  -local  admissible  conditional  finite 
sequence  at  tf  1  e  SP*_1,  local  finite  sequence  of  parameter  estimates  at  Tfi 1 . 

Definition  10.3.1  Foreachi  E  1(1, IT*),  andfjfi1  E  I(7)_  i  —  Tj_i,Tj),  we  define  local  admis¬ 
sible  sample/data  observation  size  rrrfffi 1  fit  t^-1  ns  mjt-1  E  OS^-1,  where 


OS) 


i—  1 


1(2,  Tj_i  +  <Sj_i  +  k  -  1),  ifdi-i  <  n- 1, 

1(2,  di-!  +  <S$-i  +  k  -  1),  ifdi-i  >  rj_i,  k  E  1(0,  JVj_i) 


(10.3) 


Moreover,  OSk 


<1—1 


±1-1 


is  referred  as  the  local  admissible  set  of  lagged  sample/data  observation  size  at 


Remark  31  We  note  that  if  IT  =  0,  5*_i  =  0,  the  point  tlk  1  =  tk  E  [to,  T].  Thus,  (10.3)  reduces 
to 

.  .  f  1(2,  r +  1—1),  if  d  <  r, 

OS*”1  =  < 

^  1(2,  c?  +  k  —  1),  if  I  >  r,  k  E  1(0,  IV) 

DEFINITION  10.3.2  Foreachi  E  1(1,  A"*),  m^T1  E  OS]fil  in  Definition  10.3.1  and  k  E  1(0,  lVj_i), 
a  rri'C 1  -local  admissible  lagged-adapted  finite  restriction  sequence  of  conditional  sample/data  ob¬ 
servation  at  time  fjfi1  to  subpartition  P!f~ 1  o/P*^1  in  Definition  9.5.2  A  defined  by 
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l=k—m. 


Moreover,  a  1-  class  of 


admissible  lagged-adapted  finite  sequences  of  conditional  sample/data  observation  of  size  rnfi 
at  fjf1  is  defined  by 


2—1 


^r1  = ; 


(10.4) 


In  the  case  of  energy  commodity  model,  for  each  i  6  1(1,  K*),  nfijf1  €  OS(7 1 ,  we  find  corre¬ 
sponding  ml-1-  local  admissible  adapted  finite  sequence  of  conditional  sample/data  observation  at 


ji-l 


{EtFi-1(r1)|J?ri1]}f-1_„ ).  Fori  €  /(I,**),  «*«* 


72 — 1 1  k— 1 

’  l=k— m\ 


A—  1  (+i—  1 


■i— 111  /c— 1 

l=k—m X 


this  sequence  and  solutions  of  (9.63),  we  compute 


^r1).  4-1).  ^r1).  4-1),  4-1). 

<Tjy1(mfc-1'’^-1)’  G  [°>-Ni-i]>/wj,Z  e  2(1, «). 

77;/. v  /<?<r;<7s  to  a  local  finite  sequence  of  parameter  estimates  at  tf  1  defined  on  OSlffl  as  follows: 


^1(<1.«t"1)^"1(<1.4"1)."£1(<1.tir1).7}71(<1.  4T1),  <44(^4  4T1), 

i  i 


The  above  defined  collection  is  denoted  by 


(J^ki  fc'ki  'y  ki  &  k)  —  \ 


r ii\mi  44  ^/(K  44  44  4}  i_i 

J  J  J  mk  eosk 

for  j  €  7(1,  n),  i  €  7(1,77*). 


10.4  Conceptual  Computation  of  State  Simulation  Scheme 


For  the  development  of  a  conceptual  computational  scheme,  we  need  to  employ  the  method  of 
induction.  The  presented  simulation  scheme  is  based  on  the  idea  of  lagged  adaptive  expectation 
process  [88].  For  j ,  l  e  7(1,  n),  an  autocorrelation  function  (ACF)  analysis  [14,  11]  performed  on 


s  ;-i  (y),  s  i_ i  (p)  suggests  that  the  interconnected  discrete  time  dynamic  model  of  local 

TTL  k  j/C  TTLk  j/C  J 

conditional  sample  mean  and  sample  variance  statistics  in  Lemma  9.3  is  of  order  d,_i  =  2.  In  view 
of  this,  we  need  to  identify  the  initial  data.  We  begin  with  a  given  initial  data  (y'~  1  (T*_ i) ,  p!  1  (7j_i )) , 
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(2/)}m!rl1e05!rl1  ’  4>)  }m,ji160Si“11)  ’ 

(^JmL^eOSLl1  ’  Wlmr/eOS^1)  '  ^  HK;'1’  4_1),  P4<“\  4'1)) 

be  a  simulated  value  of  (E[yi_1(^-1)| J}4}],E[pi_1(tj}-1)l at  time  ffc_1  corresponding  to  an 
admissible  sequence  {E[yl-1(fp1)|J^“11],E[pl-1(fJ-1)|^“11]}J!=rfc1_mfc  €  AS}.-1.  For  q  =  1,  and 
j  G  7(1,  n),  the  simulated  value 

(ySj{<-lA~l)  =  yr^K"1.^  4  ii"1)  -  pr1^1,^1))  is  generated  from  the 

discretized  Euler  scheme  (9.51)-(9.52)  as  follows: 


ysj «  1 > 4  1 )  =  ysj  (K-i >  4-i )  +  ( «}  1  (K-i .  4-\ )  -  ysj  KUi >  4-\ ) )  x 


E«£- lK-nt>isK-i.4-i) 


,z=t 


A*+K  K-i,4-i) 


-y-«_i,4-i))  K-i.4-t)A^jK  >4  ) 


+  E  (<-i’ 4-t)yf (<-i> 4-i)AWi,KK'  > 4"  ) 


^(4") 

i— 1  xi— 1> 


4_1  G  [7i_!,  Tj), 

vr^r1’5  (4'^t-i>yi_1,s) 

A— 1  j.7—  1 


Pj(mk  >*3k  )  —  Pj(mfc_l»*fc_l)  +  \7j,j  [yj(mk-V^k-l) 

-pKK'L^C1!) 


+/T lK-1,4-i)  +  E  t’T1  K-i.CiKK-i.4-i) 


At 


+a},j  (K-i> 4->KK-i> 4-i)azjj("4  5 4  ) 

n 

+^Kfe-1i’  4-\)  E  °'}71(mfc-1i’  OiK-u  4-1i)AZ?4Kr1>  4_1), 

i# 

4"1  G 


^44") 


7 —  1  ,S  / r7~r  — 


-,i—  l,s  l,s\ 

t,y  AP  j  • 


(10.5) 


To  find  the  simulated  value  y*’s(T* )  and  pl,f{T{),  we  need  to  estimate  tt*  and  #}  by  first  simulating 


lim_t/}  1  (7,  (71— i,  y*  1>s)  =  y?( 


_  „s(mi- 1  F-l 


t— »-T. 


TV;  _  1  > 


and 


limp}  1  (t,  Tj_i,  y* 


t->7V 


,P 


s)  =  pKmk- i’4-i) 


as  follows: 
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v'MnIv^nL)  =  Vj^k-i-v  4^1-1 ) 


+ 


(uj  (irrilNi_i_v  tlN._1_1)  y.j  ^JVj^i—i))  x 

n 

.1=1 

+  ^},/(mkk-l’  ^kk-l)^^kmk-l’  ^k-i) 


1 1 

+  (mk-i-i^k-i-i)^(mk-i-i> *k-i-i)A^K™k-i’  *k-i ; 

¥j 


k(mk_  i^k-J  =  ^kmk-i-i^k-i-i) 

+  Pj(mk-i-i’*k-i-i)  7kkmk-i-i’ik-i-i)  (yj^k-i-i^k-i-i) 

-  ^Kkk-i^kk-i))  +^r1(mkk-i>ikk-i) 


+  Y1  7?v 1  (mkk  -i  >  *k-i  -i  (mk- 1  - 1  ^k- 1  - 1 ) 


j# 


At 


+  Pj(^i5vi_i-i’*JVi_i-i)  [a},j  (mNi_i-i’^i_i-i)^^i(m7Vi_i’^_i) 
n 

+  cr},t1(mk-i-i’  ^k-i-i)^(mk-i-i’  ^k-i-i^^>^mk-i’  ^k-J 
¥j 


From  this,  we  calculate  j r*  and  0*  as: 


_  E[2/j-1(Ti)|4r±1] 


(10.6) 


Thus,  yfiTi)  =  (T)— ,  Ti~\i  y,— 1,s)  andpf(T-)  =  6)^  (Tr  ,Ti_1,yi-1’s,pi~1’s). 

Let  ({y^K-1,^1)}^-1^-1’  {P-’K-Vr1)}  mi_1e05i_1)  a  mk  1-  l°cal  sequence  of 
simulated  values  coiTesponding  to  m!~ 1  -admissible  lagged  adapted  finite  sequence  of  conditional 
observation  belonging  to  AS]^1,  and  coiTesponding  term  of  sequence  (Ui- ,  Bk ,  /(’/,• ,  '7/,.  <5/,.,  <T/,.). 
Thus,  for  each  z  €  1(1,  K*),  ({y s(mtfc-1,i‘ir1)}mi-ieOSj-i,  {p's(m^' ,  t^1  )  are  the 

finite  sequence  correspondence  of  simulated  values  of  (E[y*_1(t^,_1)|J:2Ti],®[P*_1(k_1)l^:l-i]) 


at  t 


i—  1 
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10.5  Mean-Square  Sub-Optimal  Procedure 


To  find  the  best  estimate  of  (E[y(t^  1)|Jr^_^],E[p(t^,  1 ) )  using  a  local  admissible  finite  se¬ 
quence  ({y s(mjT1,4-1)}  *-i  os<-i,  {ps(m^T1,^-1)}  i-i  osi-0,  we  need  to  compute  a  finite 

°k  uk  lk  u  k 

sequence  of  quadratic  mean  square  error  corresponding  to 

({ys(mfc_1^A r1)}mi-'1eOSi-1>  {ps("rr1>C1)}mi-1eOSi-1)-  The  quadratic  mean  square  error  is 
defined  below. 


DEFINITION  10.5. 1  For  each  i  E  7(1,  K* ),  the  quadratic  mean  square  error  of 
(E[y(^_1)|7:^Ti])E^(^_1)|J:^Ti])  relative  to  each  member  of  the  term  of  local  admissible  se¬ 
quence  ({ys(mj(_1,  ijp1)}  {ps('m2if1,t2if1)}mi-iGosi-1 )  of  simulated  values  is  defined 

Lk  uk  Lk  u  k 

by 

=  ll/K-'.C1)  -  Eb-ltf'IKiillf+IKK-'.fr1)  -  E|p‘-1(«f1)l^-i]||2  ■ 

(10.7) 


For  any  arbitrary  small  positive  number  e  and  for  each  time  t\,  1  to  find  the  the  best  estimate  from 
the  admissible  simulated  values  of  simulated  sequence  of 

{y'K-1.  Olmi-ieos*-1-  {ps(mr1^r1)},ni-ieosr1  for  E[y(fAT1)l^-i]>  EDp^r1)^-!]- 


we  determine  the  following  sub-optimal  admissible  set  of  1-size  local  conditional  sample 


{  -Hr1  =  Hfe  1  e  05*  1  :  H  r-1  i-t  <  e},  for  z  G  7(1,77*). 

^  k  k  5  fe 


(10.8) 


Among  these  collected  values,  the  value  that  gives  the  minimum  E  ,-i  ,,-i  for  k  G  [0,  iVj_i] 

,l,k  ,Lk 

are  recorded  as  rh’jf1.  If  more  than  one  value  exist,  then  the  largest  of  such  rnf  1  ’s  is  recorded 
as  rrif  1 .  If  condition  (10.8)  is  not  met  at  time  FT1,  the  value  of  rrif  1  where  the  minimum 
min  £|t  1  a- i  is  attained  is  recorded  as  mf  1 .  The  e—  level  sub-optimal  estimates  of  the  parame- 

mfc_1  fc  ’  k 

ters  { ^khh1) . 

H'K-1,^1)  }  are  recorded  as 

{  «5_1  > *)•  K)~il > *0*  0}-1  (m^. , 7),  H1  > *0*  T^1  (mfc7p. , 7),  ^(mjg , 7) 

}.  Finally,  the  simulated  value  ys(m^._1,  ps(m.)T1,  t^T1)  at  time  7(7 1  with  rnf  1  is  now 

recorded  as  the  best  estimate  forE[y*-1(fj(-1)| andE[p*-1(ij('_1)|.7:)(ri]-  The  value  ys  1 , 7), 
ps(m^-1,  7)  is  called  the  e—  sub-optimal  simulated  value  of  yfi/mf  \fk  ')  and  ps  (nfijf 1  •  t)T 1 )  of 

Ely<_1(ifc"1)l-7fc-i]  andE[p*-1(4“1)l-nii]  attjT1. 
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10.6  Illustration:  Application  of  Conceptual  Computational  Algorithm  to  Energy  Commod¬ 
ity  Data  Set 

In  this  subsection,  we  apply  the  above  conceptual  computational  algorithm  to  study  the  relationship 
between  three  energy  commodities  by  setting  n  =  3  in  (9.45).  The  three  energy  commodities  arc 
daily  Henry  Hub  Natural  gas  data  set,  daily  crude  oil  data  set,  and  daily  coal  data  set  for  the  period 
of  05/04/2009  —  01/03/2014,  [26,  27,  28].  Thus,  for  each  pair  (yi,pi),  ( U2,P2 ),  and  (2/3, ^>3), 
the  drift  and  diffusion  coefficient  function  of  the  stochastic  dynamic  equation  governing  ( yj,Pj ), 
for  j  6  4(1,3)  have  4  and  3  parameters  each  to  be  estimated,  respectively.  Thus,  there  arc  42 
parameters  to  be  estimated  in  total.  Using  At  =  1,  e  =  0.001,  for  each  j  6  7(1,  3),  the  e—  level 
sub-optimal  estimates  of  parameters  k),  k),  k*/1  (mjU1 ,  k),  7V/1  k), 

(5®/1  (mjr1,  k),  C$71  (mj.-1,  k),  l  6  7(1,  3),  at  each  real  data  times  are  exhibited  below. 

10.6.1  Illustration:  Relationship  between  Natural  Gas,  Crude  Oil  and  Coal:  Without  Incor¬ 
porating  Jump  Process. 

In  this  subsubsection,  we  analyze  the  relationship  between  Natural  Gas,  Crude  Oil,  and  Coal  without 
the  jump  process.  For  j,l  e  7(1,3),  the  stochastic  dynamic  system  governing  the  three  energy 
commodities  is  described  in  (9.48)  of  Remark  (27).  Here,  (y\  ,p\)  denotes  the  mean  spot  and  the 
spot  price  process  of  Natural  gas,  (2/2 ,  P2)  denotes  the  mean  spot  and  the  spot  price  process  of  Crude 
oil,  and  (2/3,253)  denotes  the  mean  spot  and  the  spot  price  process  of  Coal. 

Using  the  discretized  scheme  (10.5),  we  apply  the  above  conceptual  computational  algorithm  for 
the  real  time  data  sets  namely  daily  Henry  Hub  Natural  gas  data  set,  daily  crude  oil  data  set,  and 
daily  coal  data  set.  Using  r  =  10,  and  d  =  2,  the  e—  level  sub-optimal  estimates  of  the  parameters 
at  each  real  data  times  arc  described  below. 

The  parameters  corresponding  to  the  natural  gas  data  set  are  u\{rhk ,  k ),  (rhk,  k),  n \ ,  1  (rhk ,  k), 

m,2 (rhk,  k),  ki,3 (rhk,  k),  71,1  (rhk,  k),  71,2 (mk,  k),  773 (rhk,  k),  <5i,i  (rnfc,  k ),  672 (rhk,  k),  Sy3(mk,  k), 
,i(rhk,  k),  (rhk,  k),  (J\^{mk,  k).  The  parameters  corresponding  to  the  crude  oil  data  set  arc 
u2(mk,  k ),  /32(rhfe,  k),  K2,i(mk,  k ),  k2,2 {mk,  k),  k2,3 ifhk,  k ) ,  72,1  (mfc,  k),  72,2 (mk,  k),  72,3 (mk,  k), 
h,i(rhk,  k ),  S2,2(rhk,  k),  S2t3(rhk,  k),  cr2ti(rhk ,  k),  <j2)2 (fhk,  k),  cr2^(mk,  k).  The  parameters  cor¬ 
responding  to  coal  data  set  are  U3(mklk),  ^3 (mk:P3,k),  K3ti(rhk,k),  K3,2(rhk,k),  ^3,3 (rhk,k), 

73.1  (rhk,  k ),  73,2 (.mk,  k),  73,3 {rhk,  k),  <53ii(mfe,  k),  S3j2(mk,  k ),  53t3(rhkl  k ),  a3;i(mfe,  k),  a3j2(mk,  k ), 

&3,3  (rhk,  k). 
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The  following  table  gives  the  parameter  estimates  ui(mk,  k),  ki,i  {ihk,  k),  ^1,2 {rhk,  k),  ^1,3 (rhfc,  &), 
U2,  «2,1  (rhk,  k),  k2,2 (rhk,  k),  K2,3{rhk,  k),  u3(mk,  k),  /c3)i(mfc,  /c), 

^3,2  (rhfc,  A;),  ^3,3 (rhk,  k)  for  the  decoupled  system  for  y  in  the  case  where  jump  is  not  incorporated 
into  the  system. 


Table  15:  Estimates  rnk,  ui{rhk,  k),  «i,i (rhk,  k),  «i,2 (rhk,  k),  «i,3 (rhk,  k),  u2{rhk,  k),  k2,i (rhk,  k), 
k2,2 (rhk,  k),  ^2,3 (rhk,  k),  u3(fhk ,  k),  ac3,i (rhk,  k),  k3)2 (mk,  k),  n3 ,3{mk,  k)  (without  jump). 


t k 

Natural  gas 

Crude  oil 

Coal 

rhk 

u\ 

«1,1 

K  1,2 

«1,3 

U2 

K  2,1 

K2,2 

K  2,3 

U3 

«3,1 

K  3,2 

«3,3 

xlO-16 

xl0~18 

xlO-18 

xl0~18 

xlO-18 

xlO-18 

11 

1 

4.1593 

0.0211 

0 

0 

57.7000 

0 

0 

0 

16.7407 

0 

0 

0 

12 

3 

4.2000 

0.0111 

0 

0 

58.6313 

0.0011 

0.0310 

-0.0012 

16.2395 

0 

0 

-0.0376 

13 

5 

4.0616 

0.0679 

-0.0054 

-0.0035 

58.5378 

-0.0035 

0.0205 

0.0032 

16.2680 

0 

0 

0.1069 

14 

5 

4.0616 

-0.0242 

-0.0179 

0 

61.4809 

0.0020 

0.0098 

0 

15.5249 

0 

0 

-0.0294 

15 

8 

4.0910 

0.6416 

-0.2898 

0 

58.9282 

-0.0036 

0.0128 

0.0071 

16.8286 

0 

0 

0.0513 

16 

8 

4.0160 

0.2101 

0 

0 

59.6867 

-0.0051 

0.0080 

0.0071 

17.0888 

0 

0 

0.0415 

17 

8 

4.9575 

0.1876 

0 

0 

60.6244 

0.0024 

0.0052 

0 

17.4120 

-0.0003 

0.0001 

0.0555 

IS 

8 

4.9575 

-0.1947 

0 

0 

61.0700 

0 

0 

0 

17.2374 

0 

-0 

0 

19 

6 

4.7336 

-1.4476 

5.8820 

0 

61.9414 

0 

0.0043 

-0.0086 

16.8438 

0.0001 

0.0001 

0.0768 

20 

6 

2.5646 

0.3319 

0.7261 

0 

62.7899 

0 

0.0053 

0.0082 

18.3022 

-0.0083 

0.0027 

0.0558 

495 

8 

3.9654 

0.0591 

-0 

0 

108.2457 

0.0038 

0.0049 

-0.0023 

33.1313 

0.0027 

0.0009 

0.0363 

496 

5 

4.0421 

0.0616 

0.0001 

0.0017 

107.5186 

0 

0 

0 

33.4224 

-0.0005 

0.0003 

0.0214 

497 

6 

4.0514 

0.0127 

-0.0002 

0.0020 

109.8836 

0 

0 

-0.0001 

33.3388 

0.0002 

0 

0.0443 

498 

7 

4.1646 

0.0442 

-0.0012 

-0.0053 

107.8013 

-0.0021 

0.0033 

0.0038 

33.2862 

-0.0002 

0.0006 

0.0343 

499 

6 

4.1226 

0.0352 

-0.0020 

0 

108.1554 

-0.0005 

0.0032 

0.0039 

33.2862 

0.0010 

0.0001 

0.0068 

500 

6 

4.2625 

0.0733 

-0.0002 

0 

110.5101 

-0.0032 

0.0033 

0.0016 

36.1647 

0.0003 

0.0003 

0.0079 

501 

8 

3.1551 

0 

0 

-0.0009 

110.3071 

0.0014 

0.0025 

0 

34.7467 

0 

0 

0 

502 

4 

4.1564 

0.0914 

-0.0002 

0 

111.1186 

0 

0.0013 

-0.0031 

49.4050 

0.0026 

-0.0002 

0.0211 

503 

5 

4.5799 

0.0467 

0.0004 

0 

112.0057 

0 

0.0027 

-0.0043 

34.7207 

-0.0001 

-0.0001 

0.0216 

504 

4 

4.3061 

0.0236 

0.0002 

0.0007 

112.3186 

0 

0.0021 

0.0015 

34.4483 

0.0019 

0.0003 

0.0170 

505 

9 

4.4325 

-0.0015 

-0.0018 

0.0030 

106.3345 

0 

0.0043 

0.0001 

33.7160 

0 

-0.0006 

0.0265 

1102 

7 

3.5429 

-0.0286 

-0.0006 

-0.0028 

110.3777 

0.0006 

0.0045 

0 

5.2399 

0 

0.0013 

0.0008 

1103 

4 

3.5601 

0.1028 

0.0001 

0.0001 

111.1585 

-0.0003 

0.0083 

0 

5.4824 

0 

0.0077 

0.0485 

1104 

4 

3.5314 

0.0809 

0.0018 

0.0090 

109.0996 

-0.0007 

0.0095 

0.0013 

11.0949 

-0.0018 

0.0005 

0.1175 

1105 

4 

3.4439 

0.1551 

-0.0008 

-0.0015 

106.5667 

0.0033 

0.0073 

-0.0020 

4.8300 

-0.0012 

-0.0003 

0.1283 

1106 

6 

3.8206 

0.2258 

0.0004 

0 

104.7497 

0 

0 

0.0027 

4.8300 

0 

0.0008 

0 

1107 

4 

3.6917 

0.2132 

-0.0001 

-0.0008 

105.1229 

0.0011 

0.0039 

0 

4.3586 

-0.0005 

0.0004 

0.1418 

1108 

5 

3.7871 

0 

0 

0 

105.3595 

0.0006 

0.0027 

-0.0009 

4.8000 

0.0006 

-0.0001 

0.1265 

1109 

4 

3.8445 

-0.0405 

-0.0011 

0.0011 

102.9022 

-0.0044 

0.0037 

0.0039 

5.0279 

0 

0 

0 

1110 

5 

3.8399 

0.0212 

0.0004 

0 

102.8313 

-0.0020 

0.0045 

0.0018 

4.6817 

0.0021 

0.0041 

0.0536 
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Table  15  shows  the  estimates  of  the  e-  sub-optimal  size  rhk,  j  £  1(1,3),  the  parameters  u\(rhk,k),  K\,\(mk,k), 
«i,2 (mk,k),  Ki ,z(rhk,k),  u2(mk,k),  k2,i (fhk,k),  k2,2 (mk,k),  /t2,3 (mklk),  u3(mk,k),  k3i1 (rhk,k),  K3,2(mk,k), 


K3}3(mk,  fc)  for  each  of  the  energy  commodity  data  sets.  Moreover,  d  <  r  and  the  initial  real  data  time  is  tr  =  fio- 
The  following  table  gives  the  drift  coefficient’s  parameter  estimates  u\{rhk,  k),  uo {nik ■  k)  and 
?x;s  (??)/. ,  k )  for  the  decoupled  dynamical  system  for  y  in  the  case  where  jump  is  not  incorporated  into 
the  dynamical  system. 


Figure  25.:  The  graph  of  mean  level  ui(rhk,  k),  U2(rhk ,  k)  and  t/3 (fnk ,  k)  for  Natural  gas,  Crude 
oil  and  Coal,  respectively  (without  jump). 


Figures  25:  (a),  (b)  and  (c)  are  the  graphs  of  u\(rhk ,  k),  u2(mk,  k),  and  u3(rhk,  k)  against  time  tk  for  the  daily 
Henry  Hub  natural  gas  price  [27],  daily  crude  oil  price  [28],  and  daily  coal  price  [26]  data  set,  respectively.  By  plotting 
the  real  data  sets  (shown  in  Figure  31),  it  is  easily  seen  that  the  graphs  of  u\(mk,  k),  u2(rhk,  k)  and  u3(mk,  k)  are 
similar  to  the  graph  of  the  real  Henry  Hub  Natural  gas,  Crude  Oil,  and  Coal  data  set,  respectively.  We  expect  this  to 
happen  because  Uj,  j  €  7(1,3)  are  the  expected  equilibrium  spot  price  processes  described  in  (9.3).  This  analysis  shows 
that  the  parameters  Uj,  j  £  7(1,  3)  are  statistic  process  for  the  respective  mean  of  the  data  sets  at  time  tk- 
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The  graph  of  the  parameters  Kip (rhk,k),  ,2(mfc,fc),  K1)3(mfe,  k),  k2,i (rhk,k),  k2,2 {rhk,k), 
^2,3 (mfc,  fc),  K3.i(mfc,  fc),  k3 ^(rhk,  k),  and  k3j3( ,  fc)  for  the  decoupled  dynamical  system  for  y 
(with  no  jump  incorporated  into  the  dynamical  system)  are  given  below: 
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Figure  26.:  The  graph  of  interaction  coefficients  ftpi {rhk,k),  fc),  ki,3 (rhk,k), 

^2,1  {mk,  k),  k2,2 (rhk,  k )  ,  k2,3 (mfc,  k ),  k3,i (rhk,  k),  k3 k),  At3i3 (mk,  k)  (without  jump). 


Figures  26  (a)  —  ( i )  show  the  graph  of  the  e-  sub-optimal  interaction  coefficient  parameters  ki  ,i(rhk,  k ),  ki,2  (rhfc,  fe), 
ki,3 (rhk,k),  K2,i{mk,k),  K2.2 {rhk,k)  ,  K2,3 {rhk,k),  ^3,1  {mk,k),  *,3,2 {rhk,k),  «3,3 (mk,k).  The  interaction  coeffi¬ 
cients  Kj . 1 ,  j  ^  l  are  negligible,  because  each  estimate  is  <<  10~15.  Thus,  this  shows  that  the  model  describing  the 
mean  spot  price,  t/j,  is  mainly  characterized  by  the  market  potential  Kjj  (m3-  —  Vj)yj,  j  £  /(l,  n). 

The  table  below  shows  the  estimates  of  the  diffusion  coefficient’s  parameters  for  the  model  gov¬ 
erning  y. 
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Table  16:  Estimates  k),  8^2(rhk,k),  8it3(mk,k),  82,i(mk,k)  ,d2,2(mk,k),  52:3(mk,k), 

83,1  {mk,  k),  53t2(m,k,  k ),  d3t3{mk,  k)  (without  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

<5i,i 

<5i,2 

<5i,3 

<^2,1 

£2,2 

<52,3 

<53,1 

<h,2 

<53,3 

1 1 

0.0123 

0.0012 

0.0001 

0 

0.0223 

0 

0.0412 

0 

0.0022 

12 

0.0024 

0.001 1 

0.0121 

0.0234 

0.0245 

0 

0 

0 

0.0112 

13 

0.0001 

1.3425 

1.7280 

1.9811 

0.9899 

0.9731 

0.6374 

0.6374 

0.0123 

14 

0 

1 . 1267 

0.6027 

2.3258 

0.1213 

3.9128 

1.6564 

1.6564 

0.0004 

15 

1.15260 

0.4287 

0.6210 

2.3252 

0.0006 

0.5083 

1.6650 

1.6650 

0.4565 

16 

4.9354 

0 

0 

2.3217 

0.0120 

1.1124 

1 .6724 

1.6724 

0.8762 

17 

4.1360 

0.0989 

3.6877 

1.6425 

0 

0 

1.7719 

1.7719 

0 

18 

3.0410 

0.1527 

0 

1.3105 

0.9167 

1.3451 

1.7630 

1.7630 

0 

19 

2.7713 

0 

0 

1.1052 

0 

3.3241 

1 .7400 

1.7400 

0 

20 

2.8461 

0.0012 

0.2221 

0.1196 

5.1929 

0 

0.6532 

0.9876 

0.0082 

494 

2.9961 

0.0586 

0 

0.5529 

0 

0.42339 

0 

0 

0.5187 

495 

5.9059 

0 

0.0584 

0.5488 

0.8947 

0 

0.0017 

0.0021 

0.0001 

496 

0.1121 

0 

0.6613 

0.5767 

0.9899 

0 

0.8763 

0 

0.9827 

497 

1.1229 

0.0095 

0.0988 

0.6499 

5.8547 

0 

1.1317 

1.1317 

0.0012 

498 

0.6946 

0.0101 

0 

0 

5.8298 

0.0320 

1 .0294 

1.0294 

0.0321 

499 

0.7353 

0.0066 

0.0384 

0 

5.7180 

0.0330 

0.7317 

0.7317 

0.0431 

500 

1.7509 

0.0069 

0.0283 

0.4307 

5.6133 

0.0413 

0.4826 

0.4826 

0.0783 

501 

2.1299 

0.0077 

0.0282 

0.5043 

5.6282 

0.0308 

0.4272 

0.4272 

0.0002 

502 

0.9778 

0.0077 

0.0255 

0.2878 

4.6543 

0.0322 

0.5239 

0.5239 

0.0098 

503 

0.9872 

0 

0 

0.2909 

4.5544 

0.0411 

1.4523 

1.4523 

0.0087 

504 

1.1329 

0 

0 

0.3707 

0 

0.1128 

2.4181 

2.4181 

0 

505 

1.9178 

0 

0 

0.3812 

1.3243 

0.1724 

4.9207 

4.9207 

0 

1102 

0 

0.0331 

0.0056 

0.9297 

3.9502 

0 

0.2853 

1.8033 

1.1355 

1103 

1.5077 

0.0626 

0.0332 

1.1017 

2.8221 

0 

0 

0 

1.4133 

1104 

0 

0.0435 

0.5821 

0.1939 

4.5585 

0 

0 

0 

1.1672 

1105 

0 

0 

1.52970 

0.1922 

3.2418 

0.7273 

0.2726 

0.2726 

0 

1106 

4.4476 

0.323 

0.5112 

3.5487 

3.8113 

1.0179 

0.3296 

0.3296 

0 

1107 

2.4312 

0.001 1 

0.0435 

0.2001 

2.6026 

0.9354 

0 

0 

1.7245 

1108 

2.5079 

0.1232 

0.4542 

0.3781 

0 

0.8825 

0.1878 

0.1878 

0 

1109 

1.7828 

0.0431 

0.3210 

0.4024 

0 

0.8812 

0 

0 

1.3191 

1 1 10 

1.2706 

0.0056 

1.1123 

0.3252 

0 

0.8078 

0 

0 

1.0233 

The  graph  of  the  diffusion  coefficient’s  parameter  for  the  decoupled  dynamical  system  for  y 
without  jump  incorporated  into  the  dynamical  system  are  given  below: 
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Figure  27.:  The  graph  of  interaction  coefficients  5m  (rrik,  k),  Si}2(rhk,  k),  5\^{mk,  k),  S2,i(rhk,  k), 
^2,2 {mk,  k )  ,  52,3(mk,  k),  53,i(mfc,  k),  53,2(mfc,  k ),  53,3(mfe,  A)  (without  jump). 


Figures  27  (a)  —  (i)  show  the  graph  of  the  e-  sub-optimal  interaction  measure  of  fluctuation  coefficient  parameters 

Si,i(mk,  k),  <5i,2(mfe,  k),  Sil3(mk,  k),  <52,i(mfc,  fc),  <52,2(mfc,  fe)  ,  52,3(rhk,  fe),  53,i{mk,k),  83^{fhk,k),  S3,3(mk,  k), 

respectively. 

The  following  table  gives  the  drift  coefficient’s  parameter  estimates  fii(mk.  k),  71,1  (mk,k), 
71,2 (mfe,  A),  7i,3 ("ifc,  &),  ^2(mfc,  A),  72,1  (mfe,  fe),  72,2 (mfe,  A),  7 2,3  (m*,  A),  /33(mfc,  A),  73,i(mfc,  A:), 
73,2(t7tfc)  A),  and  7 3,3(mfc,  A)  for  the  dynamical  system  for  p  (without  incorporating  jump  process 
in  the  model  describing  the  system  p). 
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Table  17:  Estimates  / 3i(rhk,k ),  7i,i(mfc,  k),  71,2 {mk,k),  71, 3 (mk,k),  /32(mk,k),  72,1  (rhk,k), 
72,2 (mfc,  fe),  72,3 (mfc,  A;),  A;),  73,t("ifc,  A:),  73,2  (m*,  fc),  73,3 (mfc,  A:)  (without  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

ft 

7i,i 

71,2 

71,3 

ft 

72,1 

72,2 

72,3 

ft 

73,1 

73,2 

73,3 

1 1 

0.3462 

0.2579 

-0.0039 

0.0218 

0.0029 

0.0023 

0.0056 

0.0124 

0 

0 

0.0432 

0.0012 

12 

0.1681 

0.3497 

-0.0109 

0.0248 

0 

0 

0 

0 

0.6812 

-0.3513 

0.0248 

0 

13 

0.1592 

0.3755 

-0.0102 

0.0228 

-0.0490 

0.0228 

0 

-0.0027 

1.0795 

-0.2904 

0.0135 

0 

14 

-0.0889 

0.5001 

-0.0069 

0.0257 

-0.3700 

-0.1689 

0 

0.0633 

-0.6689 

-0.1969 

0.0166 

0.0177 

15 

0.7025 

0.6513 

-0.0242 

0.0376 

-0.0903 

-0.1737 

0 

0.0477 

-0.8220 

-0.0944 

0.0061 

0.0291 

16 

0.6727 

0.6513 

0.0188 

-0.1048 

0.3425 

-0.1847 

0 

0.0252 

-0.0480 

0.0694 

-0.0112 

0.0165 

17 

0.3253 

0.3674 

-0.0103 

0.0140 

-0.4531 

-0.1457 

0 

0.0638 

-3.6240 

0.1086 

0.0266 

0.0569 

18 

0.1523 

0.3433 

0.0014 

-0.0163 

4.0859 

0.2320 

0.3114 

-0.2889 

-1.3277 

-0.0566 

0.0088 

0.0353 

19 

-7.9573 

0.3433 

-0.2058 

1.1496 

0.1389 

-0.0677 

0.0004 

0.0065 

-0.9232 

0.0368 

-0.0277 

0.0883 

20 

0.0514 

0.3028 

0.0041 

-0.0192 

-0.1464 

-0.0409 

0.0004 

0.0178 

-1.9138 

0.0530 

-0.0104 

0.0836 

495 

0.0552 

0.2994 

0.0015 

-0.0063 

1.8435 

-0.1608 

0.1040 

-0.0368 

0.5815 

-0.3597 

-0.0050 

0.0350 

496 

0.1799 

0.1860 

0.0004 

-0.0067 

1.5682 

-0.0268 

0.4723 

-0.0502 

0.8586 

-0.2029 

-0.0094 

0.0241 

497 

0.8047 

0.1923 

0.0023 

-0.0314 

6.6699 

-0.2655 

0.4723 

-0.1649 

0.7191 

-0.2061 

-0.0053 

0.0172 

498 

0.2742 

0.2651 

0.0020 

-0.0145 

1.0042 

0.0088 

0.0226 

-0.0315 

0.3978 

-0.1680 

-0.0034 

0.0161 

499 

0.4915 

0.2295 

-0.0006 

-0.0125 

1.3074 

0.3761 

0.0073 

-0.0872 

0.1425 

-0.1899 

-0.0026 

0.0224 

500 

0.5659 

0.1618 

0.0008 

-0.0194 

0.4040 

-0.0889 

0.0392 

-0.0011 

0.3674 

-0.2313 

-0.0073 

0.0331 

501 

0.4498 

0.1679 

0.0010 

-0.0167 

0.4230 

-0.1297 

0.0434 

0.0035 

-0.9002 

1.1703 

-0.0775 

0.1011 

502 

0.4836 

0.1850 

-0.0001 

-0.0139 

0.5570 

-0.1502 

0.0384 

0.0022 

-0.2313 

0.6524 

-0.0496 

0.0663 

503 

0.4696 

0.1850 

0.1224 

-0.0919 

-0.0441 

0.0299 

0.0384 

-0.0023 

3.7804 

0.0120 

-0.0498 

0.0389 

504 

-0.0456 

0.1850 

0.0088 

-0.0270 

0.6112 

-0.0820 

0.0425 

-0.0080 

6.4696 

0.4005 

-0.0950 

0.0543 

505 

0.0464 

1.7125 

-0.0423 

0.1339 

0.7135 

-0.1115 

0.1135 

-0.0082 

2.2295 

0.0897 

-0.0357 

0.0306 

1102 

0.6765 

0.0455 

-0.0020 

-0.0908 

0.2863 

-0.2183 

0.1891 

0.1028 

4.3927 

3.8144 

0.1072 

0.0250 

1103 

1.1804 

0.4214 

-0.0149 

0.0837 

-2.1858 

0.4491 

0.1891 

0.1135 

-6.1960 

0.7446 

0.0261 

0.0144 

1104 

0.1069 

0.2489 

-0.0009 

-0.0014 

-2.1178 

0.3406 

0.1959 

0.1826 

-6.4415 

0.0339 

-0.0037 

0.1429 

1105 

0.2367 

0.0128 

0.0065 

-0.0019 

0.2633 

0.0565 

0.0742 

-0.0997 

0.6510 

2.4930 

0.0714 

0.1429 

1106 

0.1178 

0 

0 

-0.0014 

0.1384 

0.0784 

0.2014 

-0.0904 

0.6510 

2.4930 

0.6341 

0.1429 

1107 

0.1466 

0.4648 

-0.0002 

-0.0271 

0.5787 

-0.0297 

0.1305 

-0.0979 

-4.5897 

-0.0971 

0.0240 

0.0509 

1108 

0.3240 

0.2478 

0.1212 

-0.0074 

0.4293 

-0.0678 

0.0721 

-0.0389 

-4.5961 

-0.0734 

0.0233 

0.0507 

1109 

0.121 

0 

0 

-0.0021 

0.2282 

-0.0468 

0.0721 

-0.0133 

-4.5961 

-2.6776 

0.5625 

0.4702 

1 1 10 

0.002 

0 

0 

-0.0056 

0.1523 

0.0121 

0.0011 

-0.0129 

9.5959 

0.9045 

-0.1478 

0.0499 

Table  17  shows  the  estimates  of  the  parameters  j3\{rhk,k),  71,1  (fhk,k),  71,2 {rhk,k),  71.3(771*:,  fc),  p2(rhk,k). 


72.1  {rhk,k),  72.2 {rhk,k),  72,3 (mk,k),  P3 (mk,k),  ^3,\{rhk,k),  73.2 {mk,k),  ^3,3{rhk,k)  at  the  e-  sub-optimal  size 


rhfc  and  time  tk,  for  each  of  the  energy  commodity  data  sets.  Moreover,  p  <  r,  and  the  initial  real  data  time  is  tr  =  fio- 
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Figure  28.:  The  graph  of  interaction  coefficients  71,1  (rhfe,  k),  71,2(772^,  k),  71,3 (rhk,  k),  72,1  (rhk,  k), 
72,2(mfc,  k)  ,  72,3 {ihk,  k),  73,1  {rhk,  k),  73,2 (rhk ,  k),  73,3 (rhk,  k)  (without  jump). 

Figures  28  (a)  —  (i)  show  the  graph  of  the  e-  sub-optimal  interaction  coefficient  parameters  71,1  (rhk,  k),  71,2  (rhk,  k), 
7i.3 (mk,k),  72,1  (rhk,k),  72,2 (rhk,k)  ,  72,3 (mk,k),  73,1  (mk,k),  73,2 (mk,k),  73,3 (mk,k)  without  jump.  According 
to  (9.47),  the  estimate  7 j:i  (rhk,  k),  j  ^  l,  is  positive  if  commodity  pi  is  cooperating  with  commodity  pj ,  and  negative  if 
commodity  pi  is  competing  with  commodity  pj .  There  is  no  interaction  between  the  two  commodities  if  7 jti  ( rhk  ,k)  =  0. 
It  is  apparent  from  the  graph  of  71 , 3  (rhk ,  k)  that  coal  and  natural  gas  are  competing  and  cooperating  depending  on  the  time 
period.  It  is  also  apparent  graph  of  71,2 (rhk,  k)  that  natural  gas  and  crude  oil  are  also  either  cooperating  or  competing, 
depending  on  the  time  period. 

The  next  figure  shows  the  graph  of  the  parameter  estimates  k),  foirhk,  k )  and  /T3 (rhy. ,  k) 

in  the  drift  coefficient  of  the  model  describing  the  system  p. 
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Figure  29.:  The  graph  of  (3\{mk ,  k),  fai rhk ,  k)  and  /Tj(m/,..  k)  for  Natural  gas,  Crude  oil  and  Coal, 
respectively  (without  jump). 

Figures  29:  (a),  (b)  and  (c)  are  the  graphs  of  f5i(rhk,  k),  ^(rhk,  k)  and  k)  against  time  tk  for  the  daily  ffenry 

Hub  natural  gas  price  data  set  [27],  daily  crude  oil  price  data  set  [28],  and  daily  coal  price  data  set,  respectively  (without 
jump). 
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Table  18:  Estimates  CTi,i(mfe,  k),  0-1,2 (rhk,k),  <Tli3(mfc,  fe),  a2,i(rhk,  A:),  02,2 (mk,k),  a2,3{rhk,k), 
cr3,i(rhk,  k),  0-3,2 (mfc,  &)>  cr3,3(mfc,  k)  (without  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

0-1,1 

01,2 

0-1,3 

02,1 

02,2 

02,3 

03,1 

03,2 

03,3 

11 

0 

0 

0 

0 

0 

0 

0 

0 

0 

12 

0.0485 

0.0004 

0.0032 

0.2734 

0.0166 

0 

0 

0 

0.0000 

13 

0 

0 

0 

0 

0 

0 

0 

0 

0 

14 

0.2120 

0.1386 

0.0133 

1.2573 

0.4773 

0.1195 

0 

0.0665 

0.0086 

15 

0.4246 

0.1318 

0.0021 

2.1081 

0.4894 

0.1211 

0 

0.6107 

0.0696 

16 

0.5538 

0.0778 

0.1501 

0 

0.2524 

0.0811 

0.0651 

0.4251 

0.0635 

17 

1.1121 

0.0469 

0.2230 

0 

0.1848 

0.2463 

0 

0.4458 

0.0478 

18 

1.5347 

0.0180 

0.2178 

0 

0.1877 

0.1602 

0.5681 

0.0592 

0.0115 

19 

1.1315 

0.0619 

0.2221 

0 

0.2673 

0.2465 

0.4999 

0.0569 

0.0127 

20 

2.0845 

0.0536 

0.1866 

0 

0.1700 

0.0781 

0.3789 

0.3174 

0.0046 

495 

0 

0.0036 

0.0406 

0.2286 

0.0600 

0.0172 

0 

0.9387 

0.0182 

496 

0.1588 

0.0035 

0.0107 

1.4847 

0.3163 

0.0102 

0 

0 

0.0016 

497 

0.1551 

0.0009 

0.0065 

0 

0.1453 

0 

0.7777 

0 

0.0033 

498 

0.1576 

0.0011 

0.0073 

0 

0.1679 

0 

0.5334 

0 

0.0060 

499 

0.1197 

0.0006 

0.0059 

1.9414 

0.2391 

0.0172 

0.4405 

0.1432 

0.0097 

500 

0.3600 

0.0001 

0.0049 

1.9554 

0.3960 

0.0079 

0.6331 

0.1410 

0.0093 

501 

0.0514 

0.0033 

0.0049 

2.0436 

0.3499 

0.0111 

0.7690 

0.1376 

0.0089 

502 

0.2503 

0.0034 

0.0042 

2.0837 

0.1744 

0.0132 

0.6198 

0.1274 

0.0066 

503 

0.1195 

0.0147 

0.0165 

0 

0.4283 

0.0060 

1.1613 

0.1530 

0.0049 

504 

0.0974 

0.0144 

0.0027 

0 

0.2241 

0.0048 

0.4778 

0.0574 

0.0043 

505 

0.1422 

0.0060 

0.0131 

0 

0.2023 

0.0054 

0.5604 

0.0669 

0.0004 

1102 

0.1898 

0.0016 

0.0413 

0.8313 

0.0767 

0.0381 

0.6875 

0 

0.1451 

1103 

0.2094 

0.0015 

0.0352 

0.8262 

0.0673 

0.0451 

0.7298 

0.2808 

0.0147 

1104 

0.1711 

0.0011 

0.0040 

0.6648 

0.0915 

0.0462 

0.5563 

0.1831 

0.0105 

1105 

0.1816 

0.0012 

0.0116 

0.6658 

0.1049 

0.0371 

0.6591 

0.2874 

0.0057 

1106 

0.1191 

0.0011 

0.0116 

0.6260 

0.1155 

0.0393 

0 

0.0196 

0.0060 

1107 

0.0417 

0.0012 

0.0041 

0.4992 

0.0781 

0.0382 

0 

0 

0.0065 

1108 

0.1058 

0.0033 

0.0045 

0.0019 

0.0589 

0.0421 

0 

0 

0.0018 

1109 

0.1740 

0.0021 

0 

0 

0.0446 

0.0316 

2.1187 

0 

0.4511 

1110 

0.2912 

0.0021 

0.0163 

0.0385 

0.0342 

0.0037 

0 

1.1563 

0.0257 
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Table  18  gives  the  e-sub-optimal  estimates  of  the  parameters  <ti,i {rhk,  k),  <Ji,2{rhk,  k),  oi^{rhk,k),  a2,i(riik,  k), 
&2,2(rhk,  k),  (J2,3{rhk,  k),  <73,1  (m^,  k),  03,2  (m*,,  k),  u^^ifhk,  k)  for  each  of  the  energy  commodity  data  sets. 
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Figure  30.:  The  graph  of  aL1  (rhk,k),  01,2  (m*,  k),  alj3 (mk,k),  a2,i{rhk,k),  a2,2{rhk,k), 
^2,3 (iTik,k),  cr3ti(rhk,k),  cr3>2(mfc,  k),  <Ji}i{rhk,k)  for  Natural  gas,  Crude  oil  and  Coal,  respec¬ 
tively  (without  jump). 


Figures  30:  (a),  (b)  and  (c)  are  the  graphs  of  oi,i(mfc,  k),  01,2 (rhk,k),  ai^ithk,  k),  a2,i(rhk,k),  <J2,2(rhk,k), 
02,3 (rhk,  k ),  (J3,i  (rhfe,  k),  (J3^{rhk,  k),  }i(rhk,  k)  against  time  tk  for  the  daily  Henry  Hub  natural  gas  price  data  set 
[27],  daily  crude  oil  price  data  set  [28],  and  daily  coal  price  data  set,  respectively. 
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Table  19:  Real  and  simulated  estimates  (without  jump)  for  Natural  gas.  Crude  oil,  and  Coal. 


tk 

Natural  gas 

Crude  oil 

Coal 

Real 

Simulated  pf 

Real 

Simulated  p| 

Real 

Simulated  p| 

li 

4.0200 

4.0500 

58.9900 

56.5200 

16.5900 

16.8000 

12 

3.9900 

4.0500 

59.5200 

59.3099 

17.4600 

16.8635 

13 

3.7500 

3.6690 

61.4500 

59.3377 

17.8900 

17.8086 

14 

3.7700 

3.6341 

60.4900 

59.4191 

17.5500 

17.0859 

15 

3.4100 

3.3967 

61.1500 

59.6974 

17.4100 

17.0859 

16 

3.3500 

3.3967 

62.4800 

59.6974 

16.7500 

17.0859 

17 

3.4900 

3.4537 

63.4100 

61.2177 

17.6600 

19.0677 

18 

3.5500 

3.4537 

65.0900 

61.4561 

17.5200 

16.0578 

19 

3.9200 

3.8618 

66.3100 

61.6529 

18.5000 

19.0677 

20 

3.8600 

3.8618 

68.5900 

60.9364 

19.0600 

19.0677 

495 

4.1900 

4.0368 

107.1800 

104.1295 

32.7600 

31.3108 

496 

4.3300 

4.1868 

110.8400 

111.1245 

33.6500 

32.7737 

497 

4.3300 

4.1025 

111.7200 

112.4675 

33.7100 

33.4888 

498 

4.3700 

4.0964 

111.6800 

110.8795 

34.7500 

35.5907 

499 

4.3200 

4.1042 

111.7200 

104.2465 

34.5400 

32.9391 

500 

4.3500 

4.0548 

112.3100 

109.9535 

34.0400 

36.2674 

501 

4.3800 

4.0548 

112.3800 

109.9995 

33.1000 

36.2674 

502 

4.5100 

4.3249 

113.3900 

104.3254 

33.6700 

34.8915 

503 

4.6000 

4.3555 

113.0300 

113.2356 

33.9400 

35.0472 

504 

4.6000 

4.3491 

110.6000 

103.9435 

33.8300 

32.8992 

505 

4.5900 

4.3609 

108.7900 

104.9995 

32.0200 

32.8992 

1102 

3.7200 

3.5963 

108.2300 

110.5149 

4.7700 

2.8861 

1103 

3.7300 

3.5963 

106.2600 

105.8076 

5.0100 

5.6871 

1104 

3.6800 

3.4099 

104.7000 

105.8076 

4.9800 

5.3821 

1105 

3.6600 

3.4356 

103.6200 

105.8076 

4.7300 

4.9221 

1106 

3.5900 

3.4636 

103.2200 

106.9547 

4.6800 

4.2352 

1107 

3.5200 

3.2573 

102.6800 

105.4047 

4.6300 

5.8172 

1108 

3.4900 

2.8981 

103.1000 

102.4928 

4.7400 

6.0376 

1109 

3.5100 

2.8981 

102.8600 

102.4928 

4.3300 

5.1121 

1110 

3.4800 

3.0267 

102.3600 

102.4928 

4.1800 

4.8978 

Table  19  shows  the  Real  and  simulated  estimates  for  the  spot  price  processes  Pj(t),  j  £  7(1,  3)  corresponding  to  the 
natural  gas,  crude  oil  and  coal  prices. 


167 


The  next  figure  shows  the  graph  of  the  real  and  simulated  prices  for  Natural  gas,  Crude  oil,  and 


Coal  data  set. 

Real,  Simulation  for  Nat.  Gas  Real,  Simulation  for  Crude  Oil 


Real,  Simulation  for  Coal 


Figure  31.:  Real  and  Simulated  Prices  (without  jump)  for  Natural  gas,  Crude  oil,  and  Coal. 

Figures  31:  (a),  (b),  and  (c)  show  the  graph  of  the  Real  and  Simulated  Spot  Prices  for  the  daily  Henry  Hub  natural 
gas  data  set  [27],  daily  crude  oil  data  set  [28],  and  daily  coal  data  set  [26],  respectively.  The  red  line  represents  the  real 
data  set  p(tfc),  while  the  blue  line  represent  the  simulated  data  set  p s(rhk,  k).  Here,  we  begin  by  using  a  starting  delay 
of  r  =  10.  The  simulation  starts  from  tr  =  fio-  The  spikes  in  the  graph  is  as  a  result  of  jump.  The  estimates  at  the  jump 
times  are  not  fitted  properly.  To  reduce  magnitude  of  error,  we  increase  the  magnitude  of  time  delay.  We  later  compare 
this  result  with  the  case  where  jump  is  incorporated  into  the  system. 

10.6.2  Relationship  between  Natural  Gas,  Crude  Oil  and  Coal:  With  Jump  Incorporated. 

In  this  subsubsection,  we  analyze  the  relationship  between  Natural  Gas,  Crude  Oil,  and  Coal  with 
the  jump  process.  Here,  we  apply  the  above  conceptual  computational  algorithm  in  Section  10  for 
the  real  time  data  sets  namely  daily  Henry  Hub  Natural  gas  data  set,  daily  crude  oil  data  set,  and 
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daily  coal  data  set  for  the  period  of  05/04/2009  —  01/03/2014,  [26,  27,  28].  For  i  e  1(1,  K*), 
K  /  0,  we  use  At j_i  =  1;  e  =  0.001;  rj_i  =  10  and  dj_i  =  2.  The  e—  level  sub-optimal  estimates 
of  the  parameters  at  each  real  data  times  are  described  below  for  each  commodity  data  sets.  We  also 
note  that  there  are  K  =  15  jumps  in  the  system. 

The  parameters  corresponding  to  the  model  governing  natural  gas  price  data  set  are  u'f  1  (mk,  k), 

/rvrvr1).  'Ci'kt1.**-1).  w.c1). 

iit^AAkA 

^KT1^1),  ^i/)1  (mjf1,  fjT1 ),  ct j/j1  (m/r 1 ,  1 )  •  The  parameters  corresponding  to  the  model 

governing  crude  oil  price  data  set  are  u\ ^_1(mjT1,  f/_1), 


<2 kt  vn, 4:3 Krvn, tc/kt  vn, ^ kt  vn, tTsKtv 


£2— 1/^2— 1  j.2— 1  \  C2— 1  /  ~  2— 1  #2—1  \  T2  — 1/^2— 1  »2—  1\  2—  1  /  ■*  2—  1  «2— 1\  l—  1/^2—  I  *2— 1\ 

"2,1  (mk  ’t k  )’ "2,2  (mk  ’t k  )’  "2,3  (mjfc  )’ a2,l  \mk  i^k  )’ °2,2  (mfc  >  )’ 


CT. 


2,3 


1  1 ,  F  1),  while  the  parameters  corresponding  to  the  model  governing  coal  price  data  set 


jl2 —  1  "S 


4"1),  "Si1* 

A  1= 

A'1): 

'  K3,A 

A  l-. 

AA, 
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/„£_  2—  1 

AA 

’  ^3,3 

C mk 

2  —  1/  —  1  J.2 —  1  N 


For  the  sake  of  simplicity  and  in  order  to  be  able  to  compare  our  results  in  this  subsection  with  the 
results  in  subsection  10.6.1,  for  each  j,  l  <E  1(1,  n),  we  re-write  the  parameters  u/  1  (rhjr1  •  77 ' )> 

tr1),  4'1).  4_1)>  and  af¬ 

ter  they  have  been  estimated  as  Uj(rhk,k),  /3j(rhk,k),  Kjti(mk,k),  'Yj,i(rhk,k),  5jj(mk,k),  and 
<jjj(rhk,k). 

First,  we  give  results  for  the  jump  times  of  the  system  {Ti\i&1^  K*y 


Table  20:  Result  for  the  jump  times  of  the  system  (y,  p) 


T 

17 

44 

61 

87 

157 

200 

422 

464 

483 

502 

722 

754 

870 

930 

1113 

Table  20  shows  the  result  for  the  jump  times  of  the  system  (y,p).  These  results  are  derived  by  recording  the  times  at 
which  an  entry  of  a  commodity  differ  by  twice  the  standard  deviation  or  more  from  the  mean  of  that  commodity.  These 
times  are  now  combined  into  a  single  array  and  sorted  out  in  an  increasing  order.  It  follows  from  Table  20  that  K  =  15. 

We  give  the  estimate  of  the  jump  coefficient  matrices  II*  and  0*  defined  in  (9.23)  in  the  following 
table. 
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Table  21:  Estimates  7r|,  and 


Ti 

Natural  gas 

Crude  oil 

Coal 

Ti 

Natural  gas 

Crude  oil 

Coal 

i 

Tr 

ni 

TT 

TT* 

u3 

Tr 

o\ 

d\ 

f*3 

1 

17 

1.0031 

1.1219 

1.0256 

17 

1.0049 

1.1219 

1.0493 

2 

44 

0.9213 

0.9727 

1.0410 

44 

0.9352 

1.0084 

0.9249 

3 

61 

0.9482 

0.9671 

0.9661 

61 

0.9997 

0.9427 

0.9404 

4 

87 

0.8859 

0.9974 

0.9653 

87 

0.7389 

1.0452 

0.9905 

5 

157 

1.0435 

0.9350 

1.0432 

157 

1.0933 

1.0019 

1.0049 

6 

200 

1.0309 

1.0199 

1.0382 

200 

0.9826 

1.0210 

0.9794 

7 

422 

1.0270 

0.9775 

0.9669 

422 

0.9706 

0.9939 

0.9917 

8 

464 

0.9581 

1.0462 

1.0523 

464 

1.0128 

1.0508 

1.0324 

9 

483 

0.9765 

0.9787 

1.0291 

483 

1.0382 

1.0328 

1.0246 

10 

502 

1.0532 

1.0737 

1.0136 

502 

1.0359 

1.0073 

1.0162 

11 

722 

0.9812 

0.9959 

0.9919 

722 

0.9700 

0.9695 

1.0011 

12 

754 

1.0003 

1.0009 

0.9189 

754 

1.0137 

0.9987 

1.3481 

13 

870 

1.0579 

0.9921 

1.1378 

870 

1.0328 

1.0033 

1.1420 

14 

930 

1.0275 

0.9907 

0.9978 

930 

0.9995 

0.9812 

1.1848 

15 

1113 

1.0009 

0.9960 

1.0706 

1113 

0.9304 

0.9801 

0.9897 

The  following  table  gives  the  drift  coefficient’s  parameter  estimates  u\  (rhk,  k),  cu  (rhk,  k), 
«t,2 (rb.fc,  fe),  Kit3(mk,  k),  u2(rhk,  k ),  n2,i(mk,  k),  k2,2 {rhk,  k),  k2,3 (mk,  k),  u3(fhk,  k ),  K3,i(rhk,  A:), 
^'3.2  (kn.k •  /r),  K3:3(’nik.  k)  for  the  decoupled  dynamical  system  for  y  with  jump. 


Table  22:  Estimates  rh k,  u\{mk,  k),  «i,i (mk,  k),  «i,2 (m*;,  A;),  ^1,3 A:),  U2(rhk,  k),  K2,i(rhk,  k), 
n 2,2(ihk,  k),  K2,3(rhk,  k ),  u3(rhk,  k),  k3>i (rhk,  k),  k3j2 (rhk,  k),  K3}3(mk,  k)  (with  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

rhk 

u\ 

«i,i 

«1,2 

«1,3 

U2 

K2,i{rhk,  k) 

«  2,2 

«  2,3 

U3{rh,k,  k ) 

«  3,1 

«3,2 

«  3,3 

1(T16 

<10“ 16 

xicr16 

■  1(T16 

■:1(T16 

xl0~16 

11 

1 

4.1593 

0 

0 

0 

57.7000 

0 

0 

0 

16.7407 

0 

0 

0 

12 

4 

4.2000 

0 

0 

0 

58.6313 

0.0011 

0.0310 

-0.0012 

16.2395 

0 

0 

-0.0376 

13 

6 

4.0616 

0.0679 

-0.0054 

-0.0035 

58.5378 

-0.0035 

0.0205 

0.0032 

16.2680 

0 

0 

0.1069 

14 

2 

4.0616 

-0.0242 

-0.0179 

-0.0035 

61.4809 

0.0020 

0.0098 

0 

15.5249 

0 

0 

-0.0294 

15 

7 

4.0910 

0.6416 

-0.2898 

0.0078 

22.5758 

-0.0057 

0.0085 

0.0012 

18.7073 

0.0009 

-0.0021 

0.0318 

16 

4 

4.0160 

0 

0 

0.0078 

59.6867 

-0.0051 

0.0080 

0 

17.0060 

0 

-0.0021 

0 

17 

2 

4.9575 

0 

0 

0.0078 

60.3710 

-0.0005 

0.0207 

0 

12.8918 

-0.0005 

-0.0002 

0.0318 

18 

8 

4.9575 

-0.1947 

0 

0.0078 

62.3437 

0.0005 

-0.0008 

0 

16.5954 

0.0002 

0.0008 

0.0662 

19 

4 

3.3190 

-0.4472 

0.6760 

0.0078 

74.6911 

-0.0008 

-0.0019 

0 

17.9932 

0 

-0.0002 

0 

20 

1 

3.4762 

-0.2540 

-0.0048 

0.0078 

65.9190 

0.0026 

-0.0006 

1 

17.6485 

0 

0 

0.0499 

494 

1 

4.1457 

0 

0 

-0.0001 

115.1875 

0.0002 

0.0053 

0 

33.3359 

0.0003 

-0.0003 

0.0326 

495 

1 

4.2877 

0.1184 

-0.0014 

0 

124.5218 

0.0008 

0.0056 

0 

30.1732 

0.0002 

-0 

0.0412 

496 

1 

4.2238 

0.2582 

0.0011 

0.0003 

106.8349 

0.0003 

0.0113 

-0.0006 

34.9907 

0.0034 

0 

0.0097 

497 

5 

4.0998 

0.0477 

-0.0006 

-0.0002 

108.4725 

-0.0003 

0.0162 

-0.0033 

33.3388 

0.0002 

0 

0.0443 

498 

8 

4.0592 

0.0201 

0.0010 

0 

104.8926 

0 

0 

0.0003 

35.1174 

0 

0.0001 

0.0207 

499 

1 

4.3433 

0.2118 

-0.0014 

0 

109.2551 

-0.0002 

0.0048 

0.0003 

33.2862 

0.0010 

0.0001 

0.0068 

500 

4 

2.4519 

0 

0 

0 

111.7067 

0 

0 

0 

36.1647 

0.0003 

0.0003 

0.0079 

501 

1 

4.2415 

0.4108 

0 

-0.0015 

110.7517 

-0.0006 

0.0026 

0.0009 

34.9145 

-0.0001 

-0.0004 

0.0407 

502 

2 

4.3633 

0.3210 

0.0002 

-0.0001 

103.6326 

-0.0019 

0.0023 

-0.0002 

34.8337 

-0.0001 

-0.0001 

0.0140 

503 

2 

4.2911 

0.1276 

0.0003 

0.0043 

112.1547 

-0.0033 

0.0030 

0.0027 

35.8389 

0.0005 

0.0001 

0.0211 

504 

7 

4.5942 

-0.0125 

-0.0002 

-0.0031 

111.1278 

0.0010 

0.0072 

0.0006 

33.6875 

-0.0021 

0 

0.0268 

505 

2 

3.1882 

0.0666 

0.0009 

0 

106.1919 

-0.0009 

0.0110 

0.0011 

33.6640 

-0.0011 

-0.0002 

0.0231 

1102 

1 

3.5909 

0 

0 

0.0008 

110.3777 

0.0006 

0.0045 

0 

5.1761 

0.0067 

-0.0029 

-0.0044 

1103 

6 

3.5303 

0.1166 

0.0002 

-0.0003 

111.1585 

-0.0003 

0.0083 

0 

5.4558 

-0.0019 

0.0014 

0.0600 

1104 

4 

3.5314 

0.0809 

0.0018 

0 

109.0996 

-0.0007 

0.0095 

0.0013 

4.8000 

0.0005 

0.0006 

0.1742 

1105 

1 

3.7100 

0.2234 

-0.0013 

-0.0015 

106.5667 

0.0033 

0.0073 

-0.0020 

5.4226 

-0.0082 

0.0020 

0.0932 

1106 

8 

3.4084 

0.1098 

0.0001 

0 

106.5989 

0.0003 

0.0030 

0.0023 

5.3360 

-0.0023 

0.0005 

0.0956 

1107 

7 

3.5520 

0.1086 

0.0001 

-0.0070 

103.4473 

-0.0020 

0.0037 

-0.0045 

4.3586 

-0.0005 

0.0004 

0.1418 

1108 

5 

3.9233 

0.0601 

0.0007 

0 

102.8550 

0 

0.0040 

0 

4.6582 

-0.0010 

0 

0.1388 

1109 

8 

3.5328 

0.0417 

0 

0 

103 

-0.0002 

0.0089 

-0.0005 

4.9663 

-0.0019 

0.0008 

0.1279 

1110 

5 

3.8399 

0.0212 

0.0004 

0 

102.8800 

0 

0 

0 

4.7286 

-0.0037 

-0.0030 

0.0740 

The  following  figures  show  the  parameter  estimates  u\(mk ,  k),  u2 (mk ,  A:),  and  u3(  fak,  k)  for  the 
decoupled  dynamical  system  for  y  with  jump. 
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Figure  32.:  The  graph  of  mean  level  ui(rhk ,  k),  ua [nik ■  k )  and  u.3 (r/4. .  /,:)  for  Natural  gas,  Crude 
oil  and  Coal,  respectively  (with  jump). 

Figures  32:  (a),  (b)  and  (c)  are  the  graphs  of  ui(rhk,k),  v,2(rhk,k ),  and  uz(rhk,k )  against  time  tk  for  the  daily 
Henry  Hub  natural  gas  price  data  set  [27],  daily  crude  oil  price  data  set  [28],  and  daily  coal  price  data  set,  respectively. 
By  plotting  the  real  data  sets  (shown  in  Figure  38,  it  is  easily  seen  that  the  graphs  of  iti  {rhk,  k ),  U2(ihk,  k)  and  113  {rhk,  k) 
are  similar  to  the  graph  of  the  Henry  Hub  Natural  gas,  Crude  Oil,  and  Coal  data  set,  respectively.  We  expect  this  to  happen 
because  Uj,  j  G  7(1,  3)  are  the  equilibrium  spot  price  processes  described  in  (9.3). 

The  graph  of  the  interaction  parameters  k\ ,i{rhk,  k),  fin, 2  (mit,  k),  ^1,3  {rhk,  k),  ^2,1  (mfc,  k ), 

^2,2  (rnk,k),  «2,3  {jhk,k),  103,1  (rhk,k),  103,2  (rhk,k),  and  103,3  (rhfc,  fe)  for  the  decoupled  dynamical 
system  for  y  with  jump  and  estimates  in  Table  22  are  given  below: 
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Figure  33.:  The  graph  of  interaction  coefficients  ki,i (rhk,k),  ^1,2 (rhfc,fc),  ^1,3 (rhk,k), 
^2,1  {mk,  k),  K2,2 (rhk,  k )  ,  k2,3 (mfc,  fe),  fv3ii(mfc,  k),  k3 ,2(mfc,  fc),  k3i3 (mfe,  fc)  (with  jump). 


Figures  33  (a)  —  (i)  show  the  graph  of  the  e-  sub-optimal  interaction  coefficient  parameters  ki  ,i(rhk,  k ),  ki,2  (rhfc,  fe), 
ki,3 (rhk,k),  K2,i(mk,k),  K2.2 (mk,k)  ,  «2,3 (mk,k),  «3,i {rhk,k),  ft3,2 {rhk,k),  ^3,3 (mk,k).  The  interaction  coeffi¬ 
cients  Kj . 1 ,  j  ^  l  are  negligible,  because  each  estimate  is  <<  10~15.  Thus,  this  shows  that  the  model  describing  the 
mean  spot  price,  t/j,  is  mainly  characterized  by  the  market  potential  k’.~.  (m*_1  —  Vj)  Vj,  j  £  7(1,  n),  i  €  7(1,  A'*). 

The  table  below  shows  the  estimates  of  the  diffussion  coefficient’s  parameters  for  y. 
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Table  23:  Estimates  5i,i(mfc,fe),  5lt3(mk,k),  S2ji(rhk,k),  S2t2(rhk,k),  d2:3 {mk,k), 

S3,i(mk,  k ),  S3:2(rhk,  k),  63:3(mk,  k)  (with  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

<5i,i 

<5l,2 

<5i,3 

#2,1 

<52,2 

<52,3 

<53,1 

<53,2 

<53,3 

11 

0.0062 

0.0010 

0.0001 

1.5277 

0.0078 

0.0011 

0 

0 

0.0218 

12 

0.0182 

0.9002 

0 

1.6227 

0.0010 

0 

0 

0 

0.0988 

13 

0.0239 

0.0802 

1.7280 

0 

1.7694 

0 

0.6374 

0.6374 

0.0959 

14 

0 

0.0001 

0.6027 

2.3258 

0 

0 

1.6564 

1.6564 

0.0847 

15 

0 

0.8001 

0.6210 

2.3252 

0 

0 

1.6650 

1.6650 

0.0111 

16 

0.0455 

0.0007 

3.6877 

2.3217 

0 

1.2215 

1.6724 

1.6724 

0 

17 

0 

0.9876 

0 

1.6425 

0 

0 

1.7719 

1.7719 

0 

18 

3.0410 

0.9351 

0 

1.3105 

0 

0.1070 

1.7630 

1.7630 

0.0434 

19 

2.7713 

0.6680 

0 

1.1052 

0 

0 

1.7400 

1.7400 

0 

20 

2.8461 

1.7795 

0 

0.1196 

0 

0.0983 

0 

0.4555 

0 

495 

1.1229 

0 

0.0584 

0.5488 

0.1104 

0.0761 

0 

0 

1.3987 

496 

0.6946 

0 

0.6613 

0.5767 

0.0715 

0.0610 

0 

0 

1.3017 

497 

1.1229 

0.0095 

0.0988 

0.6499 

0.0870 

0.0633 

1.1317 

1.1317 

1.3069 

498 

0.6946 

0.0101 

0 

0 

0 

0.0320 

1.0294 

1.0294 

1.5410 

499 

0.7353 

0.0066 

0.0384 

0 

0.0922 

0.0330 

0.7317 

0.7317 

1.2225 

500 

1.7509 

0.0069 

0.0283 

0.4307 

0.4545 

0.0413 

0.4826 

0.4826 

1.2254 

501 

2.1299 

0.0077 

0.0282 

0.5043 

0.7873 

0.0308 

0.4272 

0.4272 

1.5587 

502 

0.9778 

0.0077 

0 

0.2878 

0 

0 

0.5239 

0.5239 

1.8713 

503 

0.9872 

0 

0 

0.2909 

0 

0 

1.4523 

1.4523 

1.8874 

504 

1.1329 

0 

0 

0.3707 

0.4261 

0 

0 

0 

0 

505 

1.9178 

0 

0 

0.3812 

0.7292 

0.1724 

0 

0 

0 

1102 

0 

0.0331 

0.7183 

0.9297 

0.0434 

0.0680 

0 

0 

1.1355 

1103 

1.5077 

0.0626 

0.2048 

1.1017 

0.0421 

0.1510 

0 

0 

1.4133 

1104 

0.4444 

0.0435 

0.4622 

0.1939 

0.1078 

0 

0.0814 

0 

1.1672 

1105 

3.5933 

0 

0.3646 

0.1922 

0 

0.7273 

0.2726 

0.2726 

1.3023 

1106 

2.4964 

0 

0.3919 

0 

0.0684 

1.0179 

0.3296 

0.3296 

1.4111 

1107 

2.4600 

0 

0.8995 

0.2001 

0.1510 

0.9354 

0 

0 

1.7245 

1108 

2.0262 

0 

0.6325 

0.3781 

0.0814 

0.8825 

0.1878 

0.1878 

1.0915 

1109 

1.7828 

0 

0.6116 

0.4024 

0.0332 

0.8812 

0 

0 

1.3191 

1110 

1.2706 

0 

0.1001 

0.3252 

0.0155 

0.8078 

0 

0 

1.0233 

The  graph  of  the  diffusion  coefficient’s  parameter  for  the  decoupled  dynamical  system  for  y  with 
jump  are  given  below: 
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Figure  34.:  The  graph  of  interaction  coefficients  4'm  (rhk.  k),  ^1,2 (m*,  k),  <$1,3 {rhk,  k),  S2ti(rhk,  k), 
82,2 (mk,  k)  ,  52,3 (rhk,  k),  53tl(rhk,  k),  S3:2(rhk,  k ),  S3i3(rhk,  k)  (with  jump). 


Figures  34  (a)  —  ( i )  show  the  graph  of  the  e-  sub-optimal  interaction  measure  of  fluctuation  coefficient  parameters 

<h,i(mfc,  k),  Si,2{fhk,  k),  6it3(mk,  k),  S2,i(mk,  k),  S2,2(mk,  k)  ,  52,3(fhk,  k ),  S3,i(mk,  k),  53,2{mk,  k),  53)3{rhk,  k ). 

The  following  table  gives  the  drift  coefficient’s  parameter  estimates  (8\{mk,  k),  71,1  (mk,k), 
7i ,2(mfe,  k),  71,3 (rhk,  k),  (32(rhk,  k),  72,1  (mk,  k),  J2,2(mk,  k),  72,3 (mk,  k),  f33(rhk,  k),  73,1  (mk,  k), 
73.2  (m./-,  A’),  and  73,3 (rhk,  k)  for  the  dynamical  system  for  p  with  jump. 
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Table  24:  Estimates  /3i(rhk,k),  71,1  (mk,  k),  71,2 (mk,k),  71,3 {rhk,k),  /32(mk,k),  72,1  {rhk,h), 
72,2 (rhk,  k),  72,3 {rhk,  k),  fo(mk,  k),  73,1  (rhk,  k),  73,2 (mk,  k ),  73,3(771  k,  k)  (with  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

ft 

7i,i 

71,2 

71,3 

ft 

72,1  {rhk,  k) 

72,2 

72,3 

ft 

73,1 

73,2 

73,3 

1 1 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

0 

12 

0.1681 

0.3497 

-0.0109 

0.0248 

-0.4815 

0.1626 

-0.4066 

-0.0123 

0.7665 

-0.3259 

0.0205 

-0.0198 

13 

0.1592 

0.3755 

-0.0102 

0.0228 

-0.7778 

-0.5752 

-0.0578 

0.1870 

1.0795 

-0.2904 

0.0135 

-0.0217 

14 

7.3439 

0.3755 

0.0488 

-0.5478 

1.7680 

-0.5555 

-0.2058 

0.0291 

0.8543 

-0.2056 

0.0034 

-0.0064 

15 

0.3336 

0.3652 

-0.0127 

0.0213 

-0.8999 

0.0601 

-0.1110 

0.0405 

0.5144 

-0.1264 

-0.0062 

0.0127 

16 

0.4709 

0.2780 

-0.0116 

0.0104 

-0.8999 

0.0601 

-0.1110 

-0.0292 

0.0017 

-0.0002 

0 

0 

17 

0.3277 

0.2780 

0.0768 

-0.2633 

1.3349 

0.0027 

-0.0330 

-0.0750 

-0.6285 

-0.0569 

0.0016 

0.0262 

18 

0.3277 

1.3156 

-0.1491 

-0.1646 

1.5419 

-0.0088 

0.1205 

-0.0892 

-1.3275 

-0.0703 

0.0080 

0.0386 

19 

0 

0 

0 

0 

-0.1785 

-0.0368 

-0.0062 

0.0189 

-0.8091 

-0.0001 

-0.0083 

0.0466 

20 

0.6985 

0.4990 

-0.0069 

-0.0187 

-0.1513 

-0.0778 

-0.0096 

0.0255 

-0.0182 

0.0080 

0.0001 

0.0003 

495 

0.1201 

0.2264 

0.0007 

-0.0056 

0.2756 

0.1131 

-0.9587 

-0.0087 

-0.0288 

-0.0780 

-0.0019 

0.0136 

496 

0.1809 

0.2085 

0.0009 

-0.0082 

0.2898 

-0.0431 

0.7329 

-0.0133 

0.1324 

-0.1434 

-0.0018 

0.0158 

497 

0.2442 

0.1597 

0.0007 

-0.0093 

3.1030 

-0.0495 

-0.0462 

-0.0862 

0.9772 

-0.2426 

-0.0065 

0.0177 

498 

0.2742 

0.2651 

0.0020 

-0.0145 

1.3147 

0.0148 

-0.0009 

-0.0411 

0.2770 

-0.1888 

-0.0037 

0.0217 

499 

0.3320 

0.3298 

-0.0009 

-0.0070 

0.8430 

0.0070 

0.0283 

-0.0265 

0.0931 

-0.1551 

-0.0041 

0.0237 

500 

0.5035 

0.2337 

-0.0007 

-0.0128 

1.3320 

0.3949 

-0.3308 

-0.0838 

0.4175 

-0.2331 

-0.0034 

0.0222 

501 

0.6328 

0.2612 

-0.0034 

-0.0077 

0.3251 

-0.1148 

0.0548 

0.0042 

0.7896 

-0.2546 

-0.0093 

0.0305 

502 

0.5403 

0.2457 

-0.0014 

-0.0113 

0.4863 

-0.1315 

0.0343 

0.0020 

3.7990 

0.0420 

-0.0524 

0.0421 

503 

0.4794 

0.2098 

-0.0028 

-0.0050 

0.1239 

0.0013 

0.0202 

-0.0040 

9.6735 

0.0736 

-0.1152 

0.0648 

504 

-0.3308 

-0.5600 

0.0258 

-0.0737 

0.2867 

-0.0391 

0.0009 

-0.0034 

4.2547 

0.3506 

-0.0669 

0.0382 

505 

1.1680 

0.8346 

-0.0274 

0.0542 

0.1198 

-0.0588 

-0.3412 

0.0092 

2.2295 

0.0897 

-0.0357 

0.0306 

1102 

0.6765 

0.0455 

-0.0020 

-0.0908 

0.4026 

-0.2544 

0.2045 

0.1058 

-5.9294 

0.6777 

0.0292 

0.0068 

1103 

1.1804 

0.4214 

-0.0149 

0.0837 

-0.6549 

0.1780 

0.0070 

0.0018 

-6.3380 

0.7440 

0.0291 

0.0106 

1104 

0.1069 

0.2489 

-0.0009 

-0.0014 

-2.1178 

0.3406 

0.1959 

0.1826 

-3.8701 

0.5681 

0.0157 

0.0021 

1105 

0.0139 

0.2777 

-0.0001 

-0.0008 

0.3958 

-0.0274 

0.0642 

-0.0620 

-4.0701 

0.1880 

0.0091 

0.0514 

1106 

-0.2513 

0.4043 

0.0031 

-0.0164 

0.4097 

0.0060 

0.1536 

-0.0907 

-5.0668 

0.3261 

0.0178 

0.0419 

1107 

0.0670 

0.3163 

-0 

-0.0145 

0.2906 

0.0485 

0.2310 

-0.0989 

-5.0668 

0.4016 

0.0308 

0.1474 

1108 

1.0112 

0.6861 

-0.0091 

-0.0107 

0.4281 

0.0048 

0.1337 

-0.0933 

-5.0668 

0.4650 

0.0304 

0.1295 

1109 

0.5020 

0.5370 

-0.0030 

-0.0375 

0.3645 

-0.0168 

0.1078 

-0.0641 

-5.0668 

0.4156 

0.0311 

0.1396 

1 1 10 

0.1420 

0.3295 

0.0009 

-0.0484 

0.1728 

-0.0189 

-0.0164 

-0.0230 

-6.6650 

0.4509 

0.0099 

0.0831 

Table  24  shows  the  estimates  of  the  parameters  rhk, Pi  (rhk,  k),  71,1  (rhk,  k),  71,2  (rhk,  k),  71,3  (rhk,  k),  rhk ,  Pi(hik,  k). 


72,1  (rhk,  k),  72,2 (rhk,  k),  72,3! rhk ,  k),  rhk,P3(rhk,  k ),  73,1  (rhk,  k),  73,2 (rhk,  k),  73,3 (rhk,  k),  for  each  of  the  energy 


commodity  data  sets.  According  to  (9.47),  the  estimate  7 j,i(rhk,  k),  j  ^  l,  is  positive  if  commodity  pi  is  cooperating 
with  commodity  p:l .  and  negative  if  commodity  pi  is  competing  with  commodity  p3 .  There  is  no  interaction  between  the 
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two  commodities  if  7j,i  fc)  =  0.  It  is  apparent  from  the  graph  (from  71 , 3 (m-k,  k)  in  Column  6)  that  coal  is  competing 
with  natural  gas  during  this  period  because  the  estimates  of  71,3 (m-k,  k)  are  mostly  negative.  It  is  apparent  that  natural 
gas  and  crude  oil  are  either  cooperating  or  competing,  depending  on  the  time  period. 

In  the  following,  the  graph  of  the  drift  coefficient’s  parameters  with  estimates  in  Table  24  are 
given  below: 


hi 


time  tk  (days) 


y12 


time  tk  (days) 
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Figure  35.:  The  graph  of  interaction  coefficients  71,1  (rhk,  k),  71,2 (ink,  k),  71,3 (rhk,  k),  72,1  (rhk,  k), 
72,2 (mfc,  fe)  ,  72,3 (rhk,  k),  73,1  (rhk,  A;),  73,2 (m*,  A:),  73,3 (mjfc,  A:)  (with  jump). 

Figures  35  (a)  —  (i)  show  the  graph  of  the  e-  sub-optimal  interaction  coefficient  parameters  71,1  (m*,  fc),  71,2  (m*,  fc), 
7i,3 (nifc,  fc),  72,1  (mk,  k),  72,2(?hfe,  fc)  ,  72,3 (m/t,  fc),  73,1  (mfc,  fc),  73,2 (mfc,  fc),  73,3 (rhk,  k).  According  to  (9.47),  the 
estimate  7 j,i(rhk,  k),  j  7^  I,  is  positive  if  commodity  p;  is  cooperating  with  commodity  Pj,  and  negative  if  commodity  p; 
is  competing  with  commodity  p, .  There  is  no  interaction  between  the  two  commodities  if  7^  (rhk,  k)  =  0.  It  is  apparent 
from  the  graph  of  71,3 (rhk,  k)  that  coal  is  competing  with  natural  gas  because  the  estimates  of  71,3 (rhk,  k)  are  mostly 
negative.  Also,  it  is  apparent  that  natural  gas  and  crude  oil  are  either  cooperating  or  competing,  depending  on  the  time 
period. 
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U,  P2 


P3 


Figure  36.:  The  graph  of  mean  level  fi\  (rhk,  ^( rhk ,  k)  and  rhk ,  k )  (with  jump). 


Figures  36:  (a),  (b)  and  (c)  are  the  graphs  of  (5\{rhk ,  k),  ^(rhk,  k),  and  fiz(rhk,  k)  against  time  tk  for  the  daily 
Henry  Hub  natural  gas  price,  [27]  daily  crude  oil  price  [28],  and  daily  coal  price  data  set,  respectively. 
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Table  25:  Estimates  cru(mfc,  A),  or>2(mfc,  k),  or ,3(mfc)  A),  cx2)i(mfe,  A:),  a2,2{mk,  k),  cr2,3(mfc,  A), 
03,1  (rafc,  A:),  a3)2(mfe,  A),  cr3i3(mfc,  A)  (with  jump). 


tk 

Natural  gas 

Crude  oil 

Coal 

<71,1 

<71,2 

<7 1,3 

<72,1 

<72,2 

(72,3 

<73,1 

< 73,2 

<73,3 

11 

0 

0 

0 

0 

0 

0 

0 

0.1303 

0 

12 

0.0485 

0.0004 

0.0032 

0.2734 

0.0166 

0 

0.0513 

0 

0.0000 

13 

0.7333 

0 

0 

0.9445 

0 

0 

0.2489 

0 

0 

14 

0.2120 

0.1386 

0.0133 

0.3877 

0.4773 

0.1195 

0.1365 

0.0665 

0.0086 

15 

0.4246 

0.1318 

0.0021 

0.03341 

0.4894 

0.1211 

0.0112 

0.6107 

0.0696 

16 

0.5538 

0.0778 

0.1501 

0.07751 

0.2524 

0.0811 

0.0651 

0.4251 

0.0635 

17 

0.3907 

0.0469 

0.2230 

0.08746 

0.1848 

0.2463 

0 

0.4458 

0.0478 

18 

0.3523 

0.0180 

0.2178 

0.04291 

0.1877 

0.1602 

0.5681 

0.0592 

0.0115 

19 

0.5116 

0.0619 

0.2221 

0.03266 

0.2673 

0.2465 

0.4999 

0.0569 

0.0127 

20 

0.6431 

0.0536 

0.1866 

0.0939 

0.1700 

0.0781 

0.3789 

0.3174 

0.0046 

495 

0 

0.0036 

0.0406 

0.2286 

0.0600 

0.0172 

0.0110 

0.9387 

0.0182 

496 

0.1588 

0.0035 

0.0107 

0.08183 

0.3163 

0.0102 

0 

0 

0.0016 

497 

0.1551 

0.0009 

0.0065 

0.07869 

0.1453 

0.4821 

0.7777 

0 

0.0033 

498 

0.1576 

0.0011 

0.0073 

0.0120 

0.1679 

0.3786 

0.5334 

0 

0.0060 

499 

0.1197 

0.0006 

0.0059 

0.0721 

0.2391 

0.0172 

0.4405 

0.1432 

0.0097 

500 

0.3600 

0.0001 

0.0049 

0.0273 

0.3960 

0.0079 

0.6331 

0.1410 

0.0093 

0.5010 

0.0514 

0.0033 

0.0049 

0.0182 

0.3499 

0.0111 

0.7690 

0.1376 

0.0089 

0.5020 

0.2503 

0.0034 

0.0042 

0.0222 

0.1744 

0.0132 

0.6198 

0.1274 

0.0066 

0.5030 

0.1195 

0.0147 

0.0165 

0 

0.4283 

0.0060 

0 

0.1530 

0.0049 

0.5040 

0.0974 

0.0144 

0.0027 

0 

0.2241 

0.0048 

0.4778 

0.0574 

0.0043 

0.5050 

0.1422 

0.0060 

0.0131 

0.0085 

0.2023 

0.0054 

0.5604 

0.0669 

0.0004 

1102 

0.1898 

0.0016 

0.0413 

0.8313 

0.0767 

0.0381 

0.6875 

0 

0.1451 

1103 

0.2094 

0.0015 

0.0352 

0.8262 

0.0673 

0.0451 

0.7298 

0.2808 

0.0147 

1104 

0.1711 

0.0011 

0.0040 

0.6648 

0.0915 

0.0462 

0.5563 

0.1831 

0.0105 

1105 

0.1816 

0.0012 

0.0116 

0.6658 

0.1049 

0.0371 

0.6591 

0.2874 

0.0057 

1106 

0.1191 

0.0011 

0.0116 

0.6260 

0.1155 

0.0393 

0 

0.0196 

0.0060 

1107 

0.0417 

0.0012 

0.0041 

0.4992 

0.0781 

0.0382 

0.0271 

0.2559 

0.0065 

1108 

0.1058 

0.0033 

0.0045 

0.0019 

0.0589 

0.0421 

0.6209 

0.8289 

0.0018 

1109 

0.1740 

0.0021 

0 

0.0305 

0.0446 

0.0316 

0.8431 

0.2366 

0.4511 

1110 

0.2912 

0.0021 

0.0163 

0.0385 

0.0342 

0.0037 

0.2910 

0.0489 

0.0257 

Table  25  gives  the  e-sub-optimal  estimates  of  the  parameters  ui(rhk,k),  cri,i(rhk,k),  <Ji,2(rhk,k),  <Ji,3(rhk,  k). 


u2(mk,  k),  cr2,i  (rhk,  k),  <72,2 (mfe,  A),  cr2,3(fhk,  k),  u3(mk,  k),  a3^(mk,  k ),  a3,2{mk,  k),  <r3y3(mk,k)  for  each  of  the 


energy  commodity  data  sets. 
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Figure  37.:  The  graph  of  ai,i(rhk,  k),  ait2{rhk,k),  crlt3(mk,k),  a2,i (mk,k),  (i2,2 (mk,k), 
C2,3(rhk,  k),  cr3:i(ifik,  k),  (J3)2{rhk,k),  03,3(77^,  A:)  for  Natural  gas,  Crude  oil  and  Coal,  respec¬ 
tively  (with  jump). 


Figures  37:  (a),  (b)  and  (c)  are  the  graphs  of  k),  <j\ ,2(mk,k),  ait3(mk,k),  <T2,i(mfe,  k),  <T2,2(mk,k), 

02,3 (ink,  k),  o-3,i (mfc,  k),  0-3,2(771*,,  k),  03, 3(777*,  k)  against  time  tk  for  the  daily  Henry  Hub  natural  gas  price  data  set 
[27],  daily  crude  oil  price  data  set  [28],  and  daily  coal  price  data  set,  respectively. 
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Table  26:  Real  and  simulated  estimates  (with  jump)  for  Natural  gas.  Crude  oil,  and  Coal. 


tk 

Natural  gas 

Crude  oil 

Coal 

Real 

Simulated  p\ 

Real 

Simulated 

Real 

Simulated  ps3 

n 

4.0200 

4.0500 

58.9900 

58.5200 

16.5900 

16.6000 

12 

3.9900 

3.9600 

59.5200 

59.5099 

17.4600 

17.4635 

13 

3.7500 

3.6690 

61.4500 

60.3377 

17.8900 

17.8886 

14 

3.7700 

3.7341 

60.4900 

59.4191 

17.5500 

17.5188 

15 

3.4100 

3.3967 

61.1500 

60.1580 

17.4100 

17.4188 

16 

3.3500 

3.3947 

62.4800 

62.5028 

16.7500 

16.7789 

17 

3.4900 

3.3900 

63.4100 

63.5524 

17.6600 

17.5341 

18 

3.5500 

3.4957 

65.0900 

64.9224 

17.5200 

17.8130 

19 

3.9200 

3.8743 

66.3100 

66.8239 

18.5000 

18.8453 

20 

3.8600 

3.8241 

68.5900 

68.1206 

19.0600 

18.9453 

494 

4.2300 

4.2295 

106.7000 

106.6374 

33.2200 

33.1852 

495 

4.1900 

4.2191 

107.1800 

106.9973 

32.7600 

32.6677 

496 

4.3300 

4.3414 

110.8400 

111.0084 

33.6500 

33.8070 

497 

4.3300 

4.3261 

111.7200 

111.7084 

33.7100 

33.7061 

498 

4.3700 

4.3863 

111.6800 

111.2084 

34.7500 

35.7057 

499 

4.3200 

4.2167 

111.7200 

111.6126 

34.5400 

33.5457 

500 

4.3500 

4.3577 

112.3100 

112.4358 

34.0400 

34.2862 

501 

4.3800 

4.3535 

112.3800 

112.5682 

33.1000 

33.1330 

502 

4.5100 

4.4389 

113.3900 

113.2925 

33.6700 

33.6216 

503 

4.6000 

4.6139 

113.0300 

113.3077 

33.9400 

33.9216 

504 

4.6000 

4.5964 

110.6000 

1 10.8350 

33.8300 

33.9216 

505 

4.5900 

4.5564 

108.7900 

108.7598 

32.0200 

31.9867 

1102 

3.7200 

3.6616 

108.2300 

108.2354 

4.7700 

4.5482 

1103 

3.7300 

3.6477 

106.2600 

106.1451 

5.0100 

5.1120 

1104 

3.6800 

3.6748 

104.7000 

104.6723 

4.9800 

5.1180 

1105 

3.6600 

3.6861 

103.6200 

104.6723 

4.7300 

4.7893 

1106 

3.5900 

3.6436 

103.2200 

102.9765 

4.6800 

4.7074 

1107 

3.5200 

3.5213 

102.6800 

102.7652 

4.6300 

4.6419 

1108 

3.4900 

3.4564 

103.1000 

102.9765 

4.7400 

4.4016 

1109 

3.5100 

3.2596 

102.8600 

102.9652 

4.3300 

4.1826 

1110 

3.4800 

3.4604 

102.3600 

102.4345 

4.1800 

4.4606 

Table  26  shows  the  Real  and  simulated  estimates  for  the  spot  price  processes  pj  ( t ),  j  £  7(1,  n). 

The  next  figure  shows  the  graph  of  the  real  and  simulated  prices  (with  jump)  for  Natural  gas, 
Crude  oil,  and  Coal  data  set 
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Real,  Simulation  for  Nat.  Gas  Real,  Simulation  for  Crude  Oil 


Real,  Simulation  for  Coal 


Figure  38.:  Real  and  Simulated  Prices  (with  jump)  for  Natural  gas,  Crude  oil,  and  Coal. 

Figures  38:  (a),  (b),  and  (c)  show  the  graph  of  the  Real  and  Simulated  Spot  Prices  for  the  daily  Henry  Hub  natural  gas 
data  set  [27],  daily  crude  oil  data  set  [28],  and  daily  coal  data  set  [26],  respectively.  The  red  line  represents  the  real  data 
set  p,  while  the  blue  line  represent  the  simulated  data  set  k .  The  graph  fits  well.  To  reduce  magnitude  of  error,  we 
increase  the  magnitude  of  time  delay.  It  is  obvious  that  these  curves  fit  better  than  the  curves  in  Figure  31.  It  follows  that 
the  interconnected  dynamical  system  with  jump  process  incorporated  into  it  performs  better  than  the  one  without  jump. 
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Chapter  11 
Forecasting 


11.1  Introduction 

In  this  chapter,  we  shall  sketch  an  outline  about  forecasting  problem  for  the  case  where  there  is 
no  jump.  The  sketch  for  the  case  where  jump  exist  is  similar.  An  e—  sub-optimal  simulated 
value  (ys(mjr1,  fjT1),  tjjT1))  at  time  ijjT1,  i  e  7(1,  K*),  are  used  to  define  a  forecast 

(y-f(rn^r1,ffc_1),  P tjT1))  for  (y(4_1),  p(4_1))  at  the  time  4_1  for  the  system  of  energy 
commodity  model. 


11.2  Forecasting  for  Energy  Commodity  Model 

In  the  context  of  Illustration  9.6.1,  for  i  e  7(1,  K*),  we  begin  forecasting  from  time  .  Using  the 
data  set  up  to  time  t jr \ ,  we  compute  rn1^ 1 ,  m^-1,  Uj(ml~l ,tl~l),  /3j(rhl~l ,  tl~ 1 ), 

4K'4r‘).  €  /(1’3)  for  a  G  -  !)•  We  assume 

that  we  have  no  information  about  the  real  data  set  {j/j(4-1)}0=fc1,  Under  these  considerations, 
imitating  the  computational  procedure  outlined  in  Section  10  and  using  solutions  to  (9.58)-(9.59), 
we  find  the  estimate  of  the  forecast  y? (mV-1,  ti-1)  and  p^  (ml-1,  ft-1)  at  time  tU 1  as  follows; 


*// ("4  4  4  4  =  4-\ )  +  («j(<-t>  4-\ )  -  ^("4-1  >  4-\ 


Kjj  ("4-t > 4-iM  ("4-i > 4-i ) 


7—1  j.2  —  1 


+  E^y;K_i,4_i) 


At 


+<44"4- i>4-i)  M"4-n4-i)  -  4_i)  WjjCfe) 


+  K("4-i>4-i)  -  2/,sK-i>4-i)  E  W(™Li>4-i)^u(*4 


(ii.i) 
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Pj(™k  >4  )  —  4-i)  ( yj(™k-v 4-i) 


-p?  ("4-i  >  4-\ ) )  +  Pi  (™l-i > 4-i ) 


2—1  j.2 —  1 


+  £  'Yj,i('^ik-ii  4-i)pf ("4-i’  4-i)  ^ 

i# 

+cri ,j  ("4- 1  >4- 1  )Pj  (”4- 1  >  4- 1 ) 4? ,3  (k) 

n 

+Pj  {rhlk-_\ ,  ffcl\ )  £  ffj,i  (mfel1! ,  4“  \  )pf  (rn£\ ,  4"\ )  (A;) , 


(11.2) 


where  the  estimates  4_\).  4-\)’  Kj,z("4-i>  4-i)>  T+K^-i’  4-\)’ 

4-1 )’  (^fc-i >  4-\)’  ^  7(1,  3)  are  estimated  with  respect  to  the  known  past  data 

set  up  to  the  time  P'k\ ■  We  note  that  y{  is  the  e-sub-optimal  estimate  for  y j(4_1)  at  dme 


To  determine  (y/(rn£\,4+11),p/(iWfc+\,  4+\ ))’weneedui("ll*  \4  X)>  Pj(™k  ^4 
M^rvsr1).  and  (^fc-1  >  *fc_1  )•  e  /(i>3)- since  we 

only  have  information  of  real  data  up  to  time  t^-i,  we  use  the  forecasted  estimate  y-  (rhjjT1, 4_1) 
as  the  estimate  of  Vj{tlkl)  and  to  estimate  Uj{rhlkl f$j{rhlkl ,  4_1)’  K+z(r4T '  ’  4~ '  )> 

7i,t("4-1>  4"1)’  and  4"1)’  7.  ^7(1,  3). 

Hence,  we  can  write  Uj{rhlkl ,tlkl)  as 

uj(™'k  >4 :  )  =  uj(™k  >%(4— m*-1+l^^d'4-m^._1+2^’  ^44-l)’ p/("4  )4  )) 

M^rVr1)  =  M™*-1’  %■  (C^-i+i)’  !+2^  %'(4-i),  y/  ("4_1>  4'1)) 

4_1)  =  ^vKT1’  ^(C^+i)’  %-(4-i)>  p/  KT^r1)) 

<  /^kt1^1)  =  /3i,K^r1>Pi(c1m*-i+i),pj(C1mi-i+2)^ •••’:p444li))pJ/(^r1>4'1)) 


7j,j(mtfc_i, 4_i)  -  (clh*-i+i)’pj(C1m*-i+2)’  ->Pi(4-i).Pi K^^r1)) 

4_1)  =  ffi,z(^r1>pj(c1<-i+i)’p^c1m*-i+2)’  -’Pj(f,k-i)’Pj  Kr^r1)), 

j,l  G  7(1,  n). 


To  find  (yj  ('"4+44+2)’  Pj  (^+2)  4+2))’  we  use  die  estimates 


44+4  4+1 


)  = 


k-mi  1+'2 


)>%(4_4i-uJ>-’%(4-i)> 


yTj ("4  4 4  4^} (^+1,2/1  ’ + x)) 


M”4+l’4+1)  =  «J,i("lU1>2'i(4-mr1+2)>%'(4-m*-1+3)>  ->%'(4-l) 


4  ("4  >4  )^  ("4+i’4+1)) 
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4/4”4+i’4+i)  — 
m™ ir+vtt+i)  = 

7i,K<+1i,4+1i)  = 
OjA^k+i^k+i)  = 


Continuing  this  process  in  this  manner, 
mates 


yfj  Kr44_14  p/  ("»fc+1n  4+\)) 

pfj  ("444  4+\)) 

pj  ("4'4 4_14pJ  (^l+\-  4+\)) 

^K™&,Pi(C^^ 

Pj  ("4_1  >  4_1 ) ’ Pj  ("4+t >  4+i ) ) >  i’1  G 

manner,  to  find  (y/ (m*+4  4+4>Pi (^+*,4+1))’  we  use  the  esti- 


ui("4+t-l’  4+t-l) 

%(4-4  r+ 

j/JW-ltf1). 

•••,p/(™44i>4+4t) 

Ki4"4+/-1>  4+t-l) 

^iK+,-1,  i ^(44nr 

— ,  2//  (^fc+i-i ,  4+i-i) 

fy,i  ("4+4 1  >  4+4 1 ) 

4-4^U-t,  %(4  _Ui+,),  Pi(4-V 

— ,  2//  (wifc+i-i ,  4+l-i) 

4j>i(r™fc+i-i>  4+t-t) 

-  Pj,l  ("4+4 1 ,  Pi  (44-4,).  Pi  (4-m*- 

Pi«  4-4  4  >■ 

••,pj«+1/-i>44-i) 

TtV^fe+i-i!  4+t-t) 

^  K+i-t  ’  ^  (4-mf : i+4 (*44-: 

pj«  4  4  V 

■••>^(7"fc+1i-i»4+t-i) 

M™i+4i>4+4t) 

^  K+4l >  Pi  ^  (4-4  r 

Pi«  44  V 

■••>^(7"fc+1i-1>4+t-1) 

+I+C’"'’ 


p?(4- 1)> 


•>Pi(4- 1)> 


Pi(4-\), 


i+«+i')’  •••’ 


11.2.1  Prediction/Confidence  Interval  for  Energy  Commodities 

In  order  to  be  able  to  assess  the  future  certainty,  we  also  discuss  about  the  prediction/confidence 
interval.  We  define  the  100(1  —  a)%  confidence  interval  for  the  forecast  of  the  state 
(y/  i- 1  A- i,p{  i-1  ,i-i)  at  time  t ll~1,  l  >  k,  j  G  1(1,  n)  as 

,zt  ml  ,zt 


y*(m\  ,t\  )±z1_a/2\s^4_Jjjj) 


Pj  (™Z  4  4  )  ±  ^1— a/2  (  C Pj  ) 
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I  /  o 

where  ( s1,]  (mj“ } ,  f  |I i ) )  ~  is  the  estimate  for  the  sample  standard  deviation  for  the  forecasted  state 
ijj ,  and  .  tj~i  )) '  ”  is  the  estimate  for  the  sample  standard  deviation  for  the  forecasted 

state  pj  derived  from  the  following  iterative  process 


y! 1,t\  4  =  yi -  yJi  K-i ,  4-! 


-  yf< 


At 


+Sj:j(ml_1,tl_1)  [Uj(ml_1,tl_1)  y  ■  {rhl_1,tl_1)  j  Wjj(l ) 


+  -  yfj  )  e  5j)iy{  (mj_i,i;_i)wrj),(o, 


TV™*-1  +i-U 


Pj( ™\  \t\  L)  =  p]{m\A,t\A)+p]{m\At\_[) 


,i— 1  +i— 1\  _  1  1 


TV™*-1  +*— H 


1  A—  1 


j  +*— 1> 


Pj^l- l!^-l) 


■  J 
n 


i— 1  In 


+  E  (Ai-ii  ti~i) 


At 


It  is  clear  that  the  95  %  confidence  interval  for  the  forecast  at  time  f/.  is 


(11.3) 


(Vk  44  1)-1-96(^-1(y/))  44  1)  +  L96(siV_l1,fe-1(yi))  )  ’ 

^K“44_1)  -  L96  ’^/(™r44_1)  +  L96  j  ’ 

where  the  lower  ends  denote  the  lower  bounds  of  the  state  estimate  and  the  upper  ends  denote  the 
upper  bounds  of  the  state  estimate. 


11.2.2  Illustration:  Prediction/Confidence  Interval  for  Energy  Commodities  with  no  jump 

For  the  case  of  no  jump,  the  following  graphs  show  the  simulated,  forecasted  and  95  percent  con¬ 
fidence  limit  for  the  daily  Henry  Hub  Natural  gas  data  set  [27],  daily  Crude  Oil  data  set  [28],  and 
daily  Coal  data  set  [26],  respectively. 
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Real,  Simulated,  Forecast  &95%  Cl  for  Natural  Gas 


time  t  (days) 


Real,  Simulated,  Forecast  and  95%  Cl  for  Coal 


Real,  Simulated,  Forecast  and  95%  Cl  for  Crude  Oil 


Figure  39.:  Real,  Simulated,  Forecasted  Prices  and  95%  C.I.  with  no  jump. 


Figures  39:  (a),  (b),  (c)  show  the  graph  of  the  forecast  and  95  percent  confidence  limit  for  the  case  where  there  is 
no  jump  for  the  daily  Henry  Hub  Natural  gas  data  set  [27],  daily  Crude  Oil  data  set  [28],  and  daily  Coal  data  set  [26], 
respectively.  Figures  39:  (a),  (b),  and  (c)  show  two  region:  the  simulation  region  S  and  the  forecast  region  F.  For  the 
simulation  region  S,  we  plot  the  real  data  set  together  with  the  simulated  data  set  as  described  in  Figure  38.  For  the 
forecast  region  F,  we  plot  the  estimate  of  the  forecast  as  explained  in  Section  11.  The  upper  and  the  lower  simulated 
sketches  in  Figure  39  (a),  (b),  and  (c)  are  corresponding  to  the  upper  and  lower  ends  of  the  95%  confidence  interval. 

11.2.3  Illustration:  Prediction/Confidence  Interval  for  Energy  Commodities  with  Jump 

For  the  case  of  jump  process,  the  following  graphs  show  the  forecast  and  95  percent  confidence 
limit  for  the  daily  Henry  Hub  Natural  gas  data  set  [27],  daily  Crude  Oil  data  set  [28],  and  daily  Coal 
data  set  [26],  respectively. 
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Real,  Simulated  and  Forecast  for  Natural  Gas  Real,  Simulated  and  Forecast  for  Crude  Oil 


Real,  Simulated  and  Forecast  for  Coal 


Figure  40.:  Real,  Simulated,  Forecasted  Prices  and  95%  Cl  with  jump. 


Figures  40:  (a),  (b),  (c)  show  the  graph  of  the  forecast  and  95  percent  confidence  limit  for  the  case  where  there  is  jump 
for  the  daily  Henry  Hub  Natural  gas  data  set  [27],  daily  Crude  Oil  data  set  [28],  and  daily  Coal  data  set  [26],  respectively. 
Figure  40:  (a),  (b),  and  (c)  show  two  region:  the  simulation  region  S  and  the  forecast  region  F.  For  the  simulation  region 
S,  we  plot  the  real  data  set  together  with  the  simulated  data  set  as  described  in  Figure  38. 
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Chapter  12 

Conclusion  and  Future  Work 


It  is  easily  seen  from  Figures  31  and  38  that  the  model  with  jump  performs  better  than  the  model 
without  jump.  This  is  because  the  curve  fits  better  at  the  jump  times  for  the  jump  case  than  the  case 
without  jump. 

For  j,  l  <G  1(1,3),  the  estimates  for  the  drift  interaction  parameters  77/  (rrik ,  iJT 1 )  for  the  case 
where  jump  is  incorporated  suggest  that  there  is  definitely  interactions  between  the  spot  price  of 
these  three  commodities.  As  discussed  in  (9.46)  and  (9.47),  the  sign  of  these  parameters  suggest 
if  there  is  competition  or  cooperation  between  commodity  l  and  j.  The  estimate  of  the  parameter 
7.7  (rh/.,  tjr1 )  in  Tables  17  and  24  and  Figures  28  and  35  suggest  that  these  commodities  either 
compete  or  cooperate  with  each  other  depending  on  the  time  period.  We  can  also  describe  the 

relationship  between  any  two  commodity  j  and  l,  j  /  l  <E  7(1,3)  based  on  the  overall  average 

N 

77/  =  (.  )T)  7?  /(?h/;.,  t'k  1  j .  For  example,  for  the  case  where  jump  is  incorporated,  773  =  —0.0017 
k= 1 

and  737  =  —0.0095.  This  suggests  that  on  the  average,  there  is  competition  between  these  two 
commodities.  Also,  717  =  0.0018  and  727  =  0.0083.  This  indicates  that  on  the  average,  there 
is  cooperation  between  natural  gas  and  crude  oil.  Finally,  77,3  =  —0.0146  and  73  2  =  —0.0013. 
Therefore,  on  the  average,  there  is  competition  between  crude  oil  and  coal. 

In  the  future,  we  plan  to  apply  the  Local  Lagged  Adapted  Generalized  Method  of  Moments  to 
interconnected  nonlinear  stochastic  dynamic  model  for  log-spot  price,  expected  log-spot  price  and 
volatility  process.  Also,  we  plan  to  incorporate  delay  in  the  multivariate  interconnected  nonlinear 
stochastic  model.  We  plan  to  be  able  to  apply  the  extended  Local  Lagged  Adapted  Generalized 
Method  of  Moments  to  other  multivariate  interconnected  nonlinear  dynamic  model  different  from 
energy  commodity  model. 
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Appendix  A 


A.l  Existence  and  Positivity  of  delayed  Volatility  in  Chapter  4 


Lemma  A.l  Suppose  u(t)  is  Ft  square-integrable,  adapted,  non-anticipative  process.  We  have 


E 


u{t)dW  (t) 


1 to 


=  0. 


(A.l) 


Proof.  We  start  by  showing  that  (A.l)  holds  for  simple  predictable  process  using  Definition  1.4.2. 
The  extension  of  the  stochastic  integral  to  square-integrable  adapted  process  follows  from  [91]. 

We  denote  W(ti)  by  Wt, ■  Using  (1.7),  we  have 


/  r°°  \  4 

/  "  \4 

E 

/  u(t)dW{t) 

=  E 

[^FhWu-WuA] 

\Jt0  J 

\i= 1  J 

=  3  £  E[F?} At*  +  ^  E  [F?]  [Ff]  At  Ah 


□ 

Denote  by  C  =  C{[— r,  0],  M)  the  Banach  space  of  all  continuous  functions  [— r,  0]  —>  M  under 
the  supremum  norm 

||a||c  =  sup  |a(0)|,  a  €  C.  (A.2) 

0S[— r,0] 

Denote  L2(C,  M)  to  be  the  Banach  space  of  all  measurable  maps  [to,  T  x  U  ->  M  which  are  L2 
with  norm 


m\h(c,R)  =  M\p\c}-  (A.3) 

Define  u(t,  ipt)  =  cr2(f,  fAt).  The  differential  equation  (4.10)  reduces  to 
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du(t,  fit)  =  f{t,u(t,fit),w)dt,  u(t0 ,fi)  =  u0(fi)  >  0. 


(A.4) 


where 


f(t,fit,w)  =  a  +  (3 


y/u[s^s)dW2(s) 


-i  2 


'  t—T 


cu(t,fit )■ 


THEOREM  A.l  Using  Lemma  A.  1,  f(t,  fit,  w)  defined  in  (A. 5)  satisfies 

\\f(t,ui,w)  -  f(t,U2,w)\\L2^to  T^xL2^nK)xn^  <  L\\u\  -  ^2 1 1 l2 ( [to,T] x C,R) 


\\f(t,u,w)\\ 
for  all  u\,  u2  G  L2([to,T]  x  C,  M) 

Proof.  For  any  u i ,  u2  G  L2([to,T]  x  C,  M) 

\\f{t,Ul,w)  -  f(t,U2,w) \\2L2  = 


<  A  (1  +  ||tl||L2([t0jT]xCjR)) 


E 


P 


^  y/ui(s,'fis)dW(s)Sj  ~  y/u2(s,fi>s)dW(s) 


+c(ui(t,fit)  ~  U2(t,fit))\ 

rt 


<  2E 


/a 


^  yV(s,  ^  y/u2(s,fis)dW(s) 

+c2  \ui(t,ipt)  -  u2(t,fit)\2 
<4/32E||(^  ^Ul(s,fis)dW(s) 


(A.5) 


(A.  6) 


+  4/?2E 


^  s/u2(s,fis)dW(s) 


+2c2E  fit)  ~  u2{t,fit)\2 
<  L\\ui(t,  ■fit)  ~  u2(t,'fit)\\2L2,  where  L  =  2c2. 


Likewise, 


||/(i,  n,  m)||22  =  E 


a  +  ^(/  Vu(s^s)dW(s)  )  +  cu(t,  'fit) 


<  262E 

<  4E 


u(s,fi8)dW(s) 


’  t  —  T 
|2  ,  „2 


+  2E  | a  +  cu(t,  fit)[ 


a fi  +  c  \u(t,fit)\“ 


<  K[  1  +  ||u||l2]  ,  where  K  =  4max{|a|2,  |c|2}. 
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□ 

Next,  we  shall  show  that  the  solution  u(t ,  ip)  of  the  IVP  (,4.4)  satisfies  Lipschitz  condition  whenever 
the  initial  condition  y(to,  ip)  =  yo(ip)  in  (A4)  satisfies  the  following  assumption: 


H2: 

a).  uo(ip )  satisfies  Lipschitz  condition,  that  is,  for  every  ip\,  ip2  6  CP  there  exist  a  constant 
Mi  >  0,  such  that 


INOl)  -  ^0 ('02)11  <  M\\\lpi  -  1p2\\, 


and 

b).  inf  uo(ip)  =  M2  >  0. 

ip 

Theorem  A. 2  Every  solution  u(t ,  ipfi)  satisfying  (A. 4)  with  initial  condition  satisfying  H2(a)  sat¬ 
isfies  Lipschitz  condition. 

Furthermore,  under  condition  H2(b),  then  \/u(t,  ipf)  satisfies  Lipschitz  condition. 


Proof.  For  any  solution  u\(t,ipi),  u2(t,ip2)  satisfying  {A. 4)  and  assumptions  H2,  with  ipi  =  ipu, 
i  =  1,  2,  we  have 


\ui(t.,ipi)  -  u2{t,ip2)\\2L2  = 


E 


P 


'to 


j*  \/ui(r,  ipi)dW(r)\  -  ^  s/ u2(r ,  ip2)dW(r 


+c(ui(s,ipi)  -  u2(s,ip2)))  ds y 


<  E 


P 


'to 


Js  y/u\  (r,  ipi)dW{r)\  -  ^  s/u2(r,  ip2)dW(r 


ds 


+c  (ui(s,ipi)  -  u2(s,  Ip2))ds 

■Jto 


<  2E 


P 


'to 


ipi)dW(r)  )  -(  /  y/u2(r,  ip2)dW{r 


ds 


+2E 


< 


c  (ui(s,ipi) -u2(s,ip2))ds 
Jt0 

2E  f  fi  f  f  y/ii!(r,  ipi)dW(r)\  -  (  f  y/u2(r ,  ip2)dW(r 

Jto  \J  s—r  J  \J  s—r 


ds 
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+2E  f  \c(ui(s,ipi)  -  U2{s,  i/j2))\2  ds 

Jt0 

<  2  b2T  f  E  f  f  s/uffr,  fi)dW(r)\  -  (  f  ^/uffry^j^)dW(T 

Jto  \J  S  —  T  J  \J  S—T 

+2 c2T  /  E  |(ui(s,  ipi)  —  U2{s,  -02 ) ) 1 2  d-s,  using  Holder’s  inequality, 

Jt0 

<2 c2T  /  ||(iti(s,-0i)  —  rt2(s,  V’2))||2ds,  using  Lemma  A.l. 

Jto 


By  Gronwall’s  inequality,  [70,  66],  we  have 

\\ui(t,i/ji)  -  u2(t,  -02)11  <  \\ui(t0,  ipi)  -  u2(to,  V;2)||ec'T" 

<  Af3||u0(t/)i)  -  ti0(^2)||,  Ms  =  ec2r2, 

<  M HV’i  —  V^Hoi  where  assumption  i72(a)  is  used,  and  M  =  M\M^. 

(A.7) 

Furthermore,  using  assumption  H ■> .  there  exist  a  positive  constant  M4  such  that  M4  <  |j  \/ui  (t,  f\  )  + 
y/u2{t,  ^2)  || -  Substituting  this  into  equation  (A.7),  we  have 

IjvV^Vh)  -  v/«2(i,V’2)||L2([t0,r]xC,R)  <  ^ll^i  -  ^Ho,  where  JV  =  M/M4.  (A.8) 


In  the  next  theorem,  we  show  conditions  for  positivity  of  the  solution  u(t,  ft)  of  (A. 4). 
THEOREM  A. 3  Differential  equation  in  (A  A)  has  a  positive  solution  if  a  >  0,  0  >  0. 


Proof.  Using  the  transformation 


z(t,ft)  =  e  CJ  to)u{t,ft), 


equation  (A. 4)  reduces  to 


dz  =  ae  cd  to^  +  j3  (J  \J  z(s,  fs)exp  —  ^( t  —  s )  dW^s)^  dt. 


Hence,  by  hypothesis,  z(t,  ft)  is  an  increasing  function  of  t.  Since  uo(to,ft)  >  0,  then  z(t,  'ft)  is 
positive.  □ 
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Appendix  B 


B.l  Algorithm  for  Simulation 

Algorithm  1  Estimating  parameters 

Given  initial  parameters  and  initial  predictions  x(t]  \  to)  and  P(t\  |to), 

for  k  =  1  to  n  do, 

for  j  =  0  to  2  do, 
for  m  =  1  to  6  do. 

Compute  y{tk\tk-i)  and  rj)m(tk\tk-i) 

Compute  x(tk\tk)  and  P(ffc|ffc)  using  (5.17), 

Compute  x(tk+i\tk)  and  P(tk+1\tk)  using  (5.26), 
Compute  ek  using  (5.27), 

end  for 
end  for 
end  for 

Return  ek. 

Compute  L(0)  using  (5.28), 

6  =  argminL(0) 

Return  L. 
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B.2  Expressions  in  Lemma  5.1 


D(tk\tky{^r} 


E(tk\tk-i) 


J(tk\tk-i)  = 

+ 


+ 


(J4  —  a 2 

2/i3 


n 

epnp&i 


~  2~T  2 ~  r  ~T 

'ph^ph  -)-  5 p h ^/p h 


p=i 


+ 


+ 


^2 

2/i3 


n 

^  ^  Cg/ipdph^tpdp/igdgh  +  epf-lqdqilfipSpfJjqdqh 


p,q=l 

p¥=q 


g\_ 

4/i4 


n 

E2~  ~T  ~  o 

Cq<5gh/ip(5p/ig(Jqh  +  ep/ipdp^tgdqhdgh 


P>9=1 

p¥=q 


+  *-  y 

2/i3  ^ 


P>9=1 

p¥=q 

2  n 


qh/ip5ph  +  epflp6p^J,q5qhfJ,qdqil 


2/i3 


y,  epC^/Up^phdph1^  +  epC^ctph/ipc/ph2 


p=i 


+ 


+ 


^2 

2/i3 


Erji  ~  _  ~  r  rT]  ~  ~  ~  ~  1 

€qC  fJjp5phf-lp5pfJ-q5qh  +  CpC  fiqSqilfJjpdpUqSqh 


p,q=l 

p¥=q 


^2 

4/i4 


n 

^  "  6^(7  5qh/J,p5pfiqdqil  4“  6p(7  /ipdp/igdghdgh 


p>g=i 

p¥=q 


+  2/i3  ^  '  ^9^  /^p<^pltg^gh^tp(5ph 

P>?=1 

p¥=q 


+  2/i3  ^  ■'  eP^  /iP^P^<?^9^1/i'?^<?^1 
P,9=l 

p¥=q 


(74 

/i3 


^  "  epfipdpia  fipSphfjpSph 


p=i 


/i3 


n 

^  *  j  i  '  j  i  ^  /  j  i  _  _ ^ 

^  ^  6gr/ip(5ph  /ip5pll/ig(5gfh  +  6gr/ip(5ph  fig  dgYiflp  (5ph 


M=1 
P/<7 

~T  ~  ~T‘ 

H-ep/Xp5ph  /ig5g,h/ig(5gh 


^2 

4/i5 


n 

E~T  co~  c*  ~T  ~T  <2  ~  ~ ^ 

C7*/Xp(5pll  (5^  — 1“  (^gll^7*(57*^Xp(5pll 


p,gJr=l 

p¥=ci¥=r 


+eqHp5ph  np5pHq5qh5rh 
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+ 


<7204 

4  h5 


n 

^  '  GqUpSph  fJjp5pfXq8qil5p\\  +  CpfiqSqh  fJ>p8pHq8qh8( 


2  yT 

qh 


P,< 2 

p¥=q 

2  ~T  ~  ~T' 

+eq5ph  Hp8phfip5pfjjqSqh 


+ 


(To 


4  h5 


.  ;  J  I  _  .  _  .  <  J  <  .  !  J  1  -  /  J  I 

^  ^  (-T [Tq 4ph  fijf 8p fi^i dqhjip 8p jif 4yli  -)~  (-  r jiff 4ph  /<p4p j(q 8 ghjXp  8 p /xp4pli 


p,q,r= i 

p^q^r 

_  ^  i  j  i  _  _  /  j  i  _  /  j  i  _  _  *  j  i 

+ep/ig<5qh  jip  dp  j  i  q  4  q  h  4r  h  -(-  er/ip8pfj,q8qli  [ip  dp  /  /  q  8  q  h  /  /  r  4r  h 


+ 


0204 

4/z5 


E2  ~  ^T-1  ~  ~  T  2  ~  T  ~  2  ~  r 

6p5ph  f.ip5phfjjq5q/j,p5pii  -I-  Cg4ph  /iq4qh<5ph 


p,<? 

p^<2 


-\-eqfTp6pfJjq5qil  /ip4ph4ph 


+ 


(To 


Ah5 


n 

y,  eq52phT  Liq5qh5rhT  +  er  82hT  /j,q  Sqh/_ir  Sr  fiqSqh1 


p,q,r=l 

p+q+r 


~\~€'['8p\l  fTq8qlilfTq8qlJJ^8'f'\\  I~lp8pfj>q8q]il  fJjp8p\\8  p  fTp  fTq8q\l 


+ 


+ 


(To 


Ah5 


£ 

p5qr,r=l 

p+q+r 


'  J  I  _  _  /  J  I  /  J  I  _  _  !  J  I 


^2^4 

4/i5 


n 

^  '  dpfTp8pfTq8qh  flqSqhSqil  H-  6r ^IpSpfTqSqh  /-Iq8qh/Jjr8r [Tp8ph 


PA 

p+q 


+eq8phT  SphnqSqh1 


+ 


+ 


A 

Ah5 


—  j  ~  2  ~  jf1  —  j  —  2  ~  i  2  ~  i  2  ^ 

fj>p8p /j>q8 qh  j i q 4g  h 8 ‘ p li  I  //p 8 p f(q 8 q h  ji q 8 ^ h 4^  h  ~ )~  4^ h  4 ^  h y ■  8 p h 


2£;t  ,  r2rT’ ,-2, 


p,g,r=l 

p+q+r 


(J2CT4 

Ah 5 


n 

. ;  j  1  _  .  _  . 1  j  1  _  /  j  i  _  _  ^ 

^  '  Cg4ph  fJjp8pfiq8q\lfip8ph  +  ep(5ph  [Xp8pfTq8qilfJ,q8qi\ 


PA 

p+q 


A~Gq8qh  fJyp8p/-lq8qilfJjp8pil  -|-  eqfJ>p8p/-lqSq\l  8ph^iq8qh 


+ 


+ 


(T2IT4 

Ah 5 


n 

E2~T  ~  ~  ~T  ~ T  2 ~ 

6p4gh  / / p 8P 1  iq 8 q h j i q 4r^ h  +  eqfj>p8pfj>q8qh  8p\\fip8p 


PA 

p+q 


CT2CT4 

Ah5 


n 

E~rp  2  ~  ~ ~T  2 ~  ~ ^ 

(‘qf(]/8p/(q8q\\  8qhfTp8ph  +  €pfJ,p8pfTq8qh  Sq\lfJ>q8qh 


PA 

p+q 


+ 


O-o 


^  '  er  /-Ip8pfiq8qh  8ril/Jjp8pil  +  [XpSpfTqSqil  8p\ll-lq8qil 


Tx2  i 


Ah 5 


p5qr,r=l 

p+q+r 


200 


Li,j  r)j p  E|  fip6phifip5phj5ph  +  fXpSphidpYij  /ipdph  +  dphifipdphj  fipdph 


+  074  ^  ^  l^pSp^il^qSqhj/XpdpfXqdqh  +  ^,2  ^  ^ 


n 

^  ^  /ip^ph^/ip(5p/ig(5ghj  /ig(5gh  +  /ip^ph 


+  ^  ^phte?T -Rjj  +  ^  Mp <5p Mg Sq hj /-%> <5ph  j ^ 6q h 


O  71  Q  TL 

(7 9  v — '  r  -  ~  „  ,~  .-  ~T  CTg  +  2(Jo  —  3(72(74  ^ — '  .  _2,~  r2i~  t-2i 

+  9/^4  Z_/  /Jp'JpMry^h^/r^V/hjMp^ph  H  ^-g  2_^((5phj5phj5ph 

p,g=l  p=l 

p¥=q 

q  n  n 

<74(72  —  (T9  v — '  n~  nr  c-2.~t  (74(72  v — '  ro  ~  r  -  ~  „  „  ~T 

+  8/l®  g^6  A-/  "ghjMpOpMgOghj/AjOgMpOph 

p,q,r= 1  p,g=l 

p^g^r  p^g 


(74  (J2  -  (72 


n 

E2  ~  _  ~  ~  X  2  ~  e  _  ~ 

(5ph^/ip5p/ig5grhj/ip(5p/ig^h  +  ^gh2/ip(5p/ig(5ghj  (ApSpflqdq 


on  n 

(J 4,(7 2  (7 2  V-^  j.  r  ~  r2il  c  r-  0"2  V~>  r-2il  7-) 

g/^6  Z_^  ^pOpl^qVqniOpnjllpOpllqOqn  +  - - /  ^p^j^jRj.i 


~  2~  ~T  ~  r2 ~  ~T 

qhiSphj  flqSqfipSph  +  (IpOp/JjqOqYlidqtlj  flqOqflpdpll 


(74(72  -  (72 


g/^6  ^  y  l^p^pf^q fiq^i Sg hj flpSpfJsqSqh 


3  n 

(74(72  ~  (72  ^ 

Q ?i6  / 


ghi/ip5p/iq-5ghj(5ph  +  fipdpflqdqliiflpSpf^qdqlijdqh 


p,q,r=l 

p^q^r 


~  ~T  ~  2~  ~T 

(^iflq5qllr5rXlj  [lp5plir8rXl  +  /Jjp5p/J,q5q)li5rllj  Ilq8q/7p5pii 


~  ~  ~  1  \  U2  \  "  a  2  'T'  2  T 

-{- (lp5pfAq5q\lif7q5qf7r5rhj {lr5rfJJp5ph  j  +  /  v  8phjCj  Rjj  +  5phjC i  R{ 
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(j:< 


+  ^ 


8  he 


p,q,r=  1 

yj^q+r 


qlliUpSpfir&r^j  q^ql*  r^'/'h 


-\-flp5pHq5qhiHp5pHr&r^j /J'r&rfl'qSq^  ^  ‘)  j)‘-  ^  (*"y  ^JJ ) 

p=l 


+ 


cr. 


2  n 


8/)6 


^  "  I^ptiphifiq5qhj fJjqSqfJ,p5ph 


p,q=l 

p¥=q 


q  n 

02  ^  I"  2~  r  r-  ~  ~T  ~  ~  , 

H- g^6  /  v  5ph2/ig(5g/ir5rhj^r5r/ig5gh  H-  /Xp(5p/iqr(5qrh^/ig(5g,/ip(5phj5, 


2hr 


p5qr,r=l 

p+q+r 


+ 


04(72 

~8hP~ 


E2  ~  ~  ~  ~  _2 ~  1 

tip  h  7  lip  bp  1 l  q  O  q  hy  /  l  //  Oq  jlp  tip  ll  +  fJ,p5p/Jjq5qhifJjqSqfJyp5phjSpil 


p,q,r=  1 
pqtq+r 


-\-  fJpdpflqdqhjflqdqfl'pdjjiXjd^Yx 


E  [A4TAAT|ytfc_1]  =  |^Q  (  ^tiphupdph7 dphupdph1 


p= i 
T 


~ t-  2  £7 ^  l^ptipl  I q  tiq  \\  f  I p() p 1 1 q  tiq  ll  /  /  ^  0^>  h  j.l'f  £);■  ll 


p,q,r= 1 

p^q^r 


+  ^  '  £72*74  ^(yh/7g<Jqh  <5ph(t/-,  z{tfi')) fiqdqil  5q\\/-lq5q\l  fJ,p5p/Jjq6qilfJjp5ph 

p,q=l 
p+q 

H-(5ph/ig5gh  5^h/ig(5q,h  +  /ip5p/ig5gh/ip(5ph 

n 

E  2  ~  ~T  2  ~  ~T  2  ~  ~  ~T  ~  ~  ~1 

0’20’4:  5ptlflq5ql\  SpliflqSqll  +  /ip5p/ig$^h/ip(5pll 

p,g=l 
P^Q 
n 

Eo  2  ~  ~T  _  ~  ~T  2  ~  _  _  ~  ~ q 

p,qr?r=l 
p/^/r 

c  ~T  2  ~  ~2 

“ I-  (^pll^qr(5g(ll 

n 

E  ~  ~T  2  ~  r*  ~ T1  ~  ~T  2 ~  ~ J_ 

*72*74  I^ptip/Jjq5qhfip5ph  5phfJ>q5qh  +  fJjp5p/J>q5qlillJ>qdqh  5p\lfiq5qh 

p,q=l 
p+q 

~T  r-c.~'2 

+/ip5p//g*5qh/ip(5ph  fjjpdpUqSqhfipdph 


202 


n 

Eo  2 ~  ~ T  o ~  _  ~ T  -  ~ T  2 ~ 

(7 2  - 1-  (5ph^Xg(5gill 


p)(j?r=l 

~T  ~  ~T 

- (~  A^p^pA^^gh^Tp^ph  ^q'(5gyL/'7’(57’h^/'7*(57*h 


+  ^  cr2(J4 


~T  e  ~  ~T 

phfipSph  fipSpfiqSqhfipdph 


H“  fJ'pSpflqSqillAqdqYl  flp5pflq5qiiflq5qh  +  flpdplIqdqYiflqdqh  SpYifJjpSph  J 

n 

_ .  _ .  *  j  i  _  _  '  j  i  _  _  i  j  i  ^  .  f-~j 

'y  ^  ^2^4  +  5ph/ig(5gh  /ip5p/ig5g-h/ig(5gth 


~T  ~  ~T 

+  ^p(5p/ig(5gh/ip(5ph  /ig(5g/ip(5ph/ip(5ph 


- 1-  ^  ^  0*2  A^p^pA^^/^A^p^p^  fJjj'S'p fJjqS qYl/U/fS'y'Yli 

p,q,r= 1 
V+qi-r 

~  ~T  ~  ~T  _  _  ~  ~ 71  _  ~  _  ~ 71 

- 1- A^P^pA^^T’^A^^"^  - 1-  AAp^pA^<7^7^A^P^P^ 

n  n 

+  2J  O’! l-lv tip fl q fiq h /Jr h  iipdpfiq5qhnr5rh  +  o^h^h  ^pjph^pdph 


p,q,r=l 

V+q-^r 


n 

yy  < 


2  ~  _2  ~  71  ~  ~  71  2  ^  ~  T  ~  ~  T 

(5gh(5ph  /ig5gh/ig5gh  +  5gh/ip(5p/ig5qfh  /ig5gh/ip5ph 


+SlMfiT  iiqSqh/iqSqhT 


n 

^  _  !  J  I  ^  ^  /  J  I  _  ^  /  J  I  _  /J 

^  ^  <72^4  5ph(5ph  /ig5gh/ig5gh  +  5ph/ip5p/ig5gfh  /ig5gh/ip5ph 


+  //p(5p/igr(5grh(5gh  /ip(5ph/ig5gh 


n 

Eq  2  ~  ~  7  —  ~  7  2  ~  ~  T  ~  ~2 


p5g-?r=l 

p^q^r 


~ \~ /jiqS q\iSp\v  fjij'S'r'iif-iq5qii 
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-|-  ^  '  <72*74  H'pfipH'qdqilSph  fipdpil/JjqSqil  -(-  fJjp5pfJjqSqil5pil  fj,q5qhfiq5qh 


2  CT. 


p,q= i 
v+q 


-{- [ipdpfiqSqilUpdpfJyqdqh  Hp8p\lflp6ph 


^  '  J  I  _  !  J  t  ^  f  j  I  _  _  t  J 

+  ^  ^  ^"2  ^ph(5^h  /^g^ghMg^gh  H-  /^g^g/^r^rh^ph 

p5g,r=l 
p^q^r 

~  o  ~T  ~  ~g 

~ l- (5-ph 

n 

+  ^  ^  ct20"4  /ig^/ip(5ph/ip5p/ig5gh  /ip(5ph/ip(5ph 

p,4=l 
p/<7 

_  .  _  .  t  J  I  _  .  *  J  I  _  .  _  .  '  J  I  _  _  t  J 

-\-  fipdpIlqdqYifipdpIlqSqh  flqdq\iflq5q\l  +  /ip5p//g(5gh(5ph  /^g$gh/ip5ph 
n 

E2 ~  ~T  ~  ~T  2 ~  ~T  ~  _  ~ 2 

^2^4  ^ph/ip(5p/ig(5qrh  /^p^ph/ig(5gh  +  (5ph/ip5p^g5gh  /ig(5gfh/ig(5gh 

p,g=l 
p/<7 

H-/ip(5p/ig5gh/ig5g/ip5ph  /ip5ph/ip5ph 
n 

- 1-  ^  ^"2  f~tpSpfJjqSq\\/Jjj‘Sj‘/JjqSq\\  fJjp&p\\/Jjy&'p\\ 

p,q,r= 1 
p/g^r 

_  ~  ~T  _  ~  ~T  _  ~  ~T  ~  _  ~T 

~\~ fMpSp fJ/qS q\\fJjpSp fJjq5 q\\fJjj‘Sj\\.  ~\~  fJjqSqfJj'fSj‘\\fJjpSp/U/qSq\\  fXi-Sj\\.fJjpSj^\. 

n  n 

— ■>  ~  2 ~T  2 ~  ~T  ^  q  ~  ~T  _  ~  ~T 

+  /  v  ^Mp^ph^h  5ph/ip5ph  +  ^  ^  ^/ip^p/ig^gh/iT-^T-h  /ir5rh/ip5p/ig5qfh 

p=l  p,g,r=l 

p^g/r 


-|-  ^  '  <72*74  (5ph(t/j ,  ^ (t/j))/ig<5qh  +  /4g<5qh<5gh  fipSpfjjqdqhi-ipSph 

p,q=  1 
v+q 

+Hq5qh5phT  5  qhnqdqh1 


E~  2  ~  T  2  ~  ~  T  ~  2  ~  T  ~  ~  l 

&2&4  Mg^gh^ph  5ph/ig(5grh  +  /ig(5grh(5ph  /ip(5p/ig5gh//p(5ph 


p,g=l 

p/g 


H-//p(5ph/ip(5p/ig(5gh 


Eo  ~  2 ~T  _  ~  ~T  ~  <2~T  _  ~  ~2 

^"2  /^g^gh(5ph  ~ l- 

p,g,r=l 
p/g^r 

~\~  fJjj'Sj\\.fiij‘5j‘ (JjqS  q\\  Sp\\/JjqSq\\ 
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-  I J  I  _  _  I  J  I  _  !  J  I  ^  ^  ?~~J 

+  ^  '  CT2^4  /^p^ph^tp(5p/ig(5qh  5ph/ig5gh  +  fj,q5q\lfj,p6pfj,q5q\l  Sph^lq5qh 


p,q=  i 
p+q 


-\-  flpdphfipdpfJjqdqh  fipdpfj,q5qhfj,p5ph 


Eo  _  ~  2~ y  2  ~  ~ T  ~  _  ~ T  o  ~ 

(J2  Sj. \\fJjqSq\\  /Jjf‘Sf\\/JjqSqfJj'pSj‘\\  Sp\\/JiqSq\\ 

p,q,r= 1 
Vi-q+r 

e  ~T  ~1 

— \~  fJjpSpfafJjpSp  fJ/qS  qYl  fJjqSqfXj‘Sj‘\\/U/'pSj‘\\ 

n 

+  ^  ^  o"2CT4  /^p^ph/i^(5g/ip5ph  /ip5p/i^5gh/ip(5ph 

m=i 

Pt^Q 

***  '  - 1  j  *  .  _  _ .  ^  j 1  .  ~  .  <  j 1  _ .  _ . 

+/4q5gh/ip(5p/ig5gh  /J,p5pfJ,q5qhlJ,q8qh  +  /. Iq5qhfj,p5pl-lq5qll  (5ph/ip5ph 


+  E 


02<74 


p,p=l 

p+q 


Hp5p\l52p\l  Llpdpfiqdqh^qdqh  +  HpSpHq6qhHp5ph  Hp5phflp8pfJ,q5qh 


-\-  flqdqhdph  (Ip5pllq5ql\llq5q\l  +  /ip5ph/ip(5p/ig(5gh  /ig5g/^p5ph/ip(5pll 
n 

^  ^"2  l~^v ^vf-^q (5^*h 

p,g?r=l 

Vi-q+r 

~  ~ T  _  ~  ~ T  ~  _  ~ T  _  ~  ~T 

fJjqS q\\fJjpSp fJjqS q\\  fljpSpfJjj‘Sj\\.IJjj‘3j\\.  ~ l-  /-Ap^pA^^yfr/'^p^p^ 

n  n 

Eo  ~  ~rp  ~  ~T  — ■>  2  ~  ~T  ~  2  ~T 

^2  A^^^V^p^pA^^?®^  Mpdp^^h/xr()rh  +  ^  v  ^6^ph/jp(^ph  /ip(5ph(5ph 

p,g,r=l  p=l 

yi-qj-r 
n 

E2  ~  ~T  ~  o  ~T  2  ~  ~  rp  ~  ~2 

(T2CJ4  (5gh/ig5gh  ^tg(5qh5ph  +  <5gh/ig5gh  np5piifjjp5piJ>q5qh 


p,q= 1 
p+q 


Jq 

E2 ~  ~T  ~  c2~T  2 ~  ~  ~T 

<72^4  ■)“  /jjpSphfXpSpfjjqSqh 

p,q= 1 
p¥=q 

H-/ip(5p/ig5gh/ip5ph  /ig(5g,h(5^h  +  /ig5g,h5gh 


+  E 


^2 


2  ~  ~  'J1  ~  ~  J1  2  ~  ~  71  _  ~  _  ~  'p 

5phnq5qh  fj,r5rhnr5r/qq5qh  +  Jph/igdgh  /.V^rh/Uq^/i-r^rh 


p,g,r=l 

p¥zq¥zr 


~\~  JJj'fSf  /JjqSq\\/JjY‘S'p\l.  fJ,qSq\\Sp\\ 


E~  ~T  ~  o~T  ~  ~T  —  _2  ~ ^ 

(72^4  fqp^pfJjqSqhfJjpdph  (J>q5qh5ph  +  fJjpdp/JjqSqhfiqdqh  /igjgh^ph 

Pi9=l 

p+q 
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Eo  r\  ~  ~  J  ~  Q  ~  ~  _  — J'  ~  q  ~ ' 

^"2  (^phj(Xg(5gh  Hg^q^^r h  “t-  ^JjqS [Jjq&q\i3p\i 


s-2uT 


p,q,r=  1 

p^q^r 


I  fJ,p5pfiqSq\lfXp5ph  j.t '! ■  & j-\l [Ji q 3 q [J/r 3/ ■  h 


+  ^  '  o-2cr4  /ig(5,y/ip5ph/ip(5ph  /-fp(5ph//p<5p/i(jl(5gh 

p,g=l 

p+g 

_ .  ._  f  j 1  _  ^ '  j  1  _ .  <  j  1  _ .  _ .  ^ 

/ig,5ghz^p5p/ig(5gh  +  z^p^pMg^ghMg^gh  z^p^ph^  h 


^  /  j  1  ^  _  /  j  1  _  _  *  j  1  _  ^  _  /  j 

-\~  ^  '  (72^4  ^ph(tfc ,  z(tfc) )/ip5ph  /ig5gh/ip(5p//g(5qh  +  5ph/ig(5qh  Hq3qilHp^pl-tjq3q^ 

p,q=l 

p+g 

+/4p(5p/ig<5gh/ip<5ph  /ip(5ph/ig(5g/ip(5ph 

n 

+  cr|  //pCtp/Ug^ph/ipClph  )Ur(5rh/ir5r/ug5gh 

p5g,r=l 

p^g^r 

~  ~T  _  ~  ~T  _  ~  ~ X1  _  ~  ~^p 

- (- Z-Zp^p/^g^g^/'^g^gfr  f-t'p S'p hz^p ^p f-^v h  - 1-  z^'Q,^Q,Z^T^'r^/^T^ir^  /•^p^pfr/^p^p/'^g^gh 

n  n 

+  2J  o'e^p^phJph  ^p(5ph5ph  +  2J  cr|/ir5rh/xr(5rh  /iptfp^gh/iptfp/Xg^h 

p=i 


+  £ 


(J2CT4 


p,g,r=l 

p¥=q¥zr 

Hqfiq^^q^  /^gOqllOph  ~^~  ^qOq^Oq^  /^p^ph/ip(5p/ip5gh 


p,g=l 

v+g 

+Hq6qh5lhT  Hq6qhS2ghT 


_  .  _  .  ;  j  1  ^  ^  /  j  1  ^  _  /  j  1  ^  /J 

+  ^  ^  ^2^4  Mg^gh^ph  Z^g^gh^ph  +  Z^g^gh^h  Z^p^ph^p^pZ^g^gh 


p,g=l 

v+q 


H-Z^p^plizip^pZig^gh  z^g^gh^gh 


Eo  ~  2  ~T  ~  ~T  ~  _2  ~T  ~  ~  j? 

0*2  Z^g^gh^ph  Z^r^r^Z^r^r/^g^gh  — I-  Z^g^gh(^ph  Z^r^r^/^'g^g/^T^T*^ 

p,g,r=l 

p/g^r 

~  ~T  2  ~3 

~ l- Zi'7*^7*hZ^T^7‘Mg^g^  /ig(^gh(5ph 


E~  ~T  ~  2  ~  ^  ~  c  ~T  ~  _2  ~  q 

&2&4  Mp^phZ^p^pMg^gh  Z^g^g^^ph  +  Zig^grhzip^pZ^g^gh  Z^g^gh^ph 


p,g=l 

v+q 

+Zip5phz^p^pZ^g^gh  Z^p^ph^p^pMg^gh 
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Eq  ~  r\  ~  J  ~  Q  ~  J  '  — ■  _  ~  J  ~  Q  ~ ' 

<7 2  fjjq&qhfipln  "t-  ^LfS^il^JjqSqfJjirSpii  ^IqSqhSpii 


2uT 


x2  uT 


p,q,r=  1 
p^q^r 


~\~  UpSph  /Ip  tip  [J/qSq\\  ^L^Sj-h^JiqSq/Jif  (5/'h 


+  'y  '  (72(74  fip5phfJ,q5qfJjp6ph  fj>p5phfj,p5pflqdqh 
p,q=l 
P+q 

_  .  ._  '  j  '  __.  _  . '  j  1  _  _  . f  J  1  _  .  _  .  rj 

fiqdqhflpdpfiqdqii  /Jjqdqtiflpdpflqdqh  +  /ig5gh/ip(5p/ig(5gll  /ip5ph5ph 
n 

E~  2  ~  T  ~  ~  rp  ~  2  ~  ~  ~  l 

&2&A  Mp^ph(5ph  /igf5gh/ip(5p/ig(5g(h  +  /igr(5gh(5ph  flq  5qhfJsp  Spflq  0  qYl 

P,^=l 
P/<7 

~  ~Tc~r  ,  ~2 

+  /i-p5ph/ip5p/ig(5g(h  /ip5ph/ig,5g/ip5ph 

n 

- 1-  ^  ^"2 

p5g,r=l 

p^q^r 

~  ~r['  ~  ~T  _  ~  ~ r  ~  ~T" 

— 1“  ^Xg(5qdl^p(5p^i(Qf(^q(ll  ^t/(7*(57*h^Xp(5p^/(7*(57*ll  “ 1“  yL/»7^  <5^  llyfXgr  /^p^ph^p^p^Xg^gll 

n  n 

+  o'2jUr5rh/Xp(5p//q5gh  /ur(5rh/ip5p^(?(5gh  +  2J  <76/Ltp()ph^p5ph  (5ph(5ph 


p5g(,r=l 

p¥zq¥=r 


p= 1 


E~  ~T  o  ~  _2  ~ 71  ~  ~T  o  ~  ~ 2 

<72<74  ^tg(5qh/ig(5qh  (5^h(5ph  +  /.ig^gh^tp^ph  <5gh^tp(5p/ig(5qh 


p,g=l 

p+q 

+IXqdqhflqSqhT52phS2qhT 


.  _  .  1  J  1  _  .  /  J  I  _  ^  _  )  J  1  _  -  _  ^  2 

+  ^  ^  ct20"4  /ig^gh/ig^gh  +  /ig5grh/ip5ph  $ph/ip5p^g5gh 


p,<?=i 

p/g 


H-/ip(5ph^g(5grh  /i-p(5p/igf5g(h(5gh 


Eo  ~  ~  p1  2  ~  ~  _  ~  71  _  ~  ~  rp  2  ~  ~  2 

<r 2  — l-  ^g((5g(li^/(^(5^1i  (5phyL/(g((5g(^x^(5^1i 

p5g,r=l 

p^q^r 

n 

Er  ~  ~T  ~  2  ~ 71  ~  ~T"  ~  2  ~ T- 

(72<74  ^tp^ph/igfjgh  ^tpfjp/igdgh^ph  -)-  /.ip(5p/ig(5qh(5ph 

p,g=l 

p+q 

~T  ~  ~T' 

+/ip(5ph/ip(5ph  fip5pfj.q5qhflp5pfjjq5qh 
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Eo  ~  ~  T  o  ~  o  ~  T  ~  ~  1  ~  o ~ 

(7 2  /JjqSq\\/JjqSq\\  (5ph(5^Il  — I-  fJjj-Sj\VfJjqS(j^Y  /JiqSq/Jjj‘S'p\\Sp\\ 


2  uT 


p,q,r=l 

p¥=q¥=r 


y JjpSpil/Ji p  <5rh  [J/pSp  [J/qSqilfJiqS  q  fJ^v  <^ph 


+  'y  '  (72(74  fj,p5phflpdph  fiqdqfip5phfj,pdpfiq5qh 


p,q=l 

p+q 


“(“/^g^gh/igjgh  fJjp5p/-lq6q\llJjp5pHqdq\l  +  /-IqdqYlfJjpdph  fJjpdpflqSqhdpil 


E~  ~  'jy  2  ~  ~  'jy  ~  ~  T  2  ~  _  ~r] 

<72*74  ^pSphfJ-q5qh  Sph^lpdpfiqSqh  /Jjqdqh/Jjq5qh  5plill-lp5pfJ-q5qh 


p,q=  i 
p+q 


-j- fip5pilfJJp5ph  flp5pHq5qhl-lq5qflp5ph 


"l-  (7  9  ^J/pSpil/Jj'i”  (5ph  [J/pSp  fJiq&qil^JjpSj' fJjqS  q\l 


p,q,r= 1 

p¥zq¥ir 

~  ~T  _  ~  ~ _  ~  ~ 'jy  ~  ~T 

- 1- [Jj q Sq\\/-tf  (^7*h  ^p(5p^g(5ghjL^p(^p^/'7-*(^7-*h  “l-  jJjf  Sj"\\/-lpSp\\  IJjqSqfJjySj\\./JjpSpfJjq3q\\ 


+ 


<72 -R 

/t2 


n 

y  ^  2 jij/Sph fi.p <5ph  -{-  /<p4ph 


p=i 


+ 


2i? 

IF 


y,  <j4<5ph<5phT  +  <4  E  ^K6  +  fip5pfJjp6pflqdqil^lpdp^lpSpfJ,q5qh 


P=  1 


P.<?=1 

p¥=q 


^2  ^  "  //p<5ph//j/)jjh 


p=i 


y]  ( In,nRi,i )  +  2i? 


Li=l 


+ 


+ 


i? 

IF 


4F 


E2~T  2 ~  2  \ — ^  _2 ~  71  2 ~  e  e  _  ~T  ~ 

(74(5ph  <Jph  +  (72  y  y  <5ph  <5gh  4”  f7pfip[7p5pHq5qlil  fipdpfJjpSp/JjqSqil 


P=  1 


p,g=l 

p+q 


E2  ~  2~T  2  ^ 2  ~  2~T  ~  ~  'l 

<74<5ph<5ph  +  <72  y  ^  5ph(5gh  +  //p 4p //p 4p /  / q 4 g h  /  /p d p f i p dp / / g  Og  h 


p=i 


p,g=l 

p+q 


R 


+3RR1 
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E  [AATACT\Ytk_1]  = 

( 


Sx 


04 

2/i4 


/jjpSphfipdph  5ph  +  2^4  ^  y  /^p^ph^tp(5ph 


V 


p= 1 


P>9=1 

P+g 

cr4 


+7^4  ^  ^  /ip^ph/igdgh  Mp^pMc/^ijh  +  2^4  ^  Mp^ph^ph  /ip(5ph 

P,g=l  p=l 

p¥=g 

9  n  9  n 

^  y  (MpW  Mp^ph)  +  ^  ^  (/^p^ph/ip^p/iq^gh  /ig(5gh) 

P>9=1  P,9=l 

p^g  p^g 


+ 


<7, 


2  »i 


2/i4 


p,g=l 

p+g 


^  '  {f-iqdqiifipdpfiqdqii  //?,();)h)  +  9/^  i  ^  >  ^ph//p5ph  /ip<5ph 


p=i 


p,g=l 

p+q 


(j‘^  10  T  (T  2 

”^9^4  ^  ;  ^ph/ig^'gh  /4g<Jgh)  +  ^4  ^  '  H'pfipH'qdqhfipdph  /ig5<jh 


p,g=l 

p¥=q 


+  ^iY  Hp6pVq$qhHqSqhT UpSpl 1  +  ^  ^((^h^h^h 


p,g=l 

p+g 


8/i6 


n  n 


p=i 

-T , 


8/i6 


p,g=l 

p+g 


p,g=l 

p^g 


O4O2  ST'  x2i>x2i.T  x2i.  1  174172  Y^  A2hA2£T A2h 

+  g/z6  z_/  ^ph^gh  ()9h  +  2_^  5ph(59h  5rh 


p,g=l 

p¥=g 


8/i6 


P+q+r 


“I-  n,  g  ^  "  ^ph^tp^p^ip^gh  [Xp5pfiq5qi\  +  Q/  6  ^  y  ^gh/ip(5p/ig5gh  fipdpfiqdqh 


( 74<72 


8/i6 


p,g=l 

p¥=q 


8/i6 


p,g=l 

p+g 


+ 


(74(72 

W 


^  "  (5gh/ip<5p//g(5ph  fiqdqfjpdph  -f-  g^6  ^  "  ()p h /  / q (^ / (/■  (Vr h  fiqdq  firdr\i 


p,g=l 

p¥=q 


p:q,r=l 

p¥zq¥zr 


+  g^6  ^  y  MpWgWph  Mp^p/^g^gh 


p,g=l 

p+q 


+ 


(74(72 

W 


^  "  fJ'pdpfiqdqhdph  fiqdq  fipdph  +  g^6  ^  y  t-l'pdpfiq5q\\dq\\  fipdpfiqdqh 


p,q= 1 

p+g 


p,g=l 

p¥=q 


8/46  ^  y  /ip^p/iqr5gh^gh  fiqdq  flpdph  +  ^  ^  /^p^p/ig^gh/ipJp/ig^gh  (5,,  h 


p,g=l 

p¥=q 


8/i6 


p5g5r=l 

p^g^r 
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(j  ^  ^  rjp  _  ^  ^  _ rj-i  ^ 

H-  ^  ^  h  /ip5p/ig5gh  +  g^g  ^  ^  /ip(5p/ig(5grh(5rh  /i^^g/ip^ph 

p,g?r=l  p5g5r=l 

p/g/r  p/<77^ 

n 

+  (Mp^pMg^gfiMp^p^^hr<5ph  +  fip5p/jJq6qh/jJp5p/jJq6qhT  5^ 


^  ^  ^H'p3pfJjq3qhfJjq3qlJjr /JJp6pfJJrSr h  H- 


p,q,r=l 

pj^q^r 


p,q,r=l 

p^q^r 


q \\/^lp 8p ^L f  S ir- h  fJ,q6qfJjr5r\i  ~\~  ^Jip8p^Jiq8qil/Jip8p^lp8p\l  /^lqSq\l 


+ 4/^2  +  bph'jeiRi,i  C  +  2  5ph5itjRit' 


E  [AATCAT\Ytk_1  = 


Y  /j,p6phiip8phTC8phT  /j,p8phnp8ph  ‘  C82  h 


T  „  r-O^T 


x  ^9/^4 


H“o7  4  ^  ^  /ip^ph/ig(5qfh  C^/ip^p/iqr^grh  +  ,4  fip5ph5pii  C  fipdph. 


ij"  ^  ^  ~  7"1  ~T  ~  ~T  ~  7 

+— — ^  ^  ^  /ip^ph(5^h  (7/ip(5ph  H-  /ip5ph/ip5p/ig5qrh  C/i^^h 


+  (/Vgh/ip5pM<?^h'  C'^p(5phT)  +  ^4  Y  <5ph/VphTC//,p5ph 


n 

^  _  i  j  1  _  *  j  1  _  ^  *  j  1  _ 

^  ^  ^ph/ig(5gh  C/ig^gfh  H“  /ip5p/iqf5gh/ip5ph  C^/ig^gh 


+  in  IJvSpUqSqhnqSq C'/ipcSph7’  +  ^  X]  ^hJph^C'^h1’ 


n 

Y  UphS^CSfi7’  +  82ph82qhTC82phT  +  82p\x82q\vTC82q\x 
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+ 


8h6 


X  6p*8qhTC6rhT  +  22  SphUpdpHqdql^CUpdpHqdqh1 


p,q,r=  1 

V+q+r 


p,q= i 
p¥=q 


+ 


+ 


+ 


(74(72 

~8hP 


^  ~  ~T  ~T  ^  _  ~T  ~rl 

^  '  8q^fJyp8pfiq5qil  C flpSpfJjqdqil  +  g/j6  A.  >  8pYlHq5qfJ,r8rtl  C  fiq8qfj,r8ril 


p,q=l 

p+q 


p,q,r=  1 
p^q^r 


(74(72 


n 

E2 ~  ~T  ~  ~ T  ~  ~  o  ~T  _ 

OqYlfipOpHqOqh  CJ flqdq flpdp\i  -\-  flp 8 p fl q 6 q ll 8 p ll  C  flpSpflqSq 


p,q= 1 
p+q 


(74(72 


E  ~  2  ~T  ~  ~ T  ~  ~  2 

/ip(5p/ig(5gh(5ph  C fiq5q/J,p5ph  -\-  flp Sp fl q 8 q ll 8 q h  C  flqSqflpSp 


p,q= i 
p+q 


-\-fJ,p8pfiqSqil5qil  C  flpSpflqSq  h 


+ 


(To 


8/l6 


E_  ~  2  ~T  ~T  ~  o ~T  ~ 7 

/ 1  p  ^  p  /  ('/  (V/  ll  ('*/■  h  C  fipSpfJjqSqh  +  /(/;  Op  /  ( 4  (X/  h  ()r  h  C  flqS  q  flp  ()p  h 


p,q,r=  1 
pj^q^r 


fip5pfJjq5qillJjp5pfiqdq\l  C8r  h 


+ 


+ 


(74(72 


n 

^  "  (^l^p8pfJ-q5qiiHp5pl-lq8qil  C8p\l  +  Hp8pfIq8qhHp8plJjq8qil  C8q\l 


(To 


8/z6 


p,g=l 

p+q 

n 

£ 

p,g,r=l 

p^q^r 


~T  ~T 

q\\/-LqS q fJj’pS'pY^  Cy  fJjpSp/JjfS^ h 


~  _  _  ~ X1  _  ~  ~X"  _  ~ T 

/-LpSp/JjqSq\\/JjqSqfJj'pSj‘\\  C*  IUit&t /ApS p\\  fJjpSpfJjq3q^\.fJjpSpfhj‘5j\\.  C'  /-tj-Sf  fMqSq\ 1 


(7f 


+  X 


8/z6 


-  ~T  ~T 

q  \\fj/p  Sp  JJjy  Oy*  h 


p,g,r=l 


+i^E(#X^+2^h 


p=l  \  i=l 


e  [^cT^c,T|ytfc_1] 


=  E  [A^CVHlVj 
=  E  [^CTC'^lT|yfc_1] 

n 

=  X  0^5ph(5)CTC//p5phr  +  ^^hCTC^hT 

P=1 
2  n 

+  X  !J-v  dp  l-lQ  8qhCT  C  flp  Sp  fiq  8q  h  +  8phCTC8qhT  +  RCTC 

p,q=l 

q+p 
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E  [AATCCT\Ytk_1  = 


'y  '  ^  2  Mp  h  ( z )  i-i p  5p  h 

p=  i 


T  ,  0-4  ^2 


4^4 


CC1 


+ 


(To 


4/i4 


E~  ~  2 ~  2 

UpOpHqOqilUpOpHqOqil  +  <5ph(5gh  +  4? 


p,g=l 

q¥=p 

W,[ACTCCT\Ytk_1\  =  CCTCCT 


cc 1 


E  ^  ^  /ip6phCT /ipdphS'fi 

p= i 


+  Z]  Mp^hCYT/jp(52)h^hT  +  ^  /Jp^phC^/jq^h/ip^/jg^h 


+  9/  4  Mp^phC  5phnpdph  +  4  (//p5phC  (5gh//,p5ph 


p.<?=i 

Pt^<? 


2/i4 


p,g=l 

Pt^<? 


T  (7, 


2  n 


2/i4 


p=l 


2/i4 


p,g=l 

p+q 


2  rl 

+  ^4  ^  ^  /7p<5phC  fTp5p{iq5qillJ,qdqil  +  /iq<5qhO  fJjp5pfJyq5qh.fJjp5p 


p,q=  i 
p+q 


+  S  Z]  (5phC'r//p(5ph/jp(5phT  +  ^  ^  ^hCT/x?^h/x?(5gh5 


p=i 
2  n 


p,g=l 

p+q 

-T  a. 


2  n 


H“  2/t4  ^  >  ITpSpf-lqdqhC  fTpdpillJjqdqil  2/l4  ^  >  ITpSpITqSqhC  fiq5qYlfipdph 

p,q= i  p.9=1 

Pt^<?  Pt^9 


+  8^  X>^CT,«],  )  +  -^  E 

P=1  P?9— 1 

p+q 

n  n 

+  ^  ]T  ^phC'T(5qh(5phr  +  ^  E  <5phC'T^h^h7 


8/i6 


P.9= 1 

p+q 


p,q=l 

p¥=q 


+ 


8/i6 


^  <5phC,T^h(5j2hT  +  ^  (5phC'T//p5p^(?(5(?h/Up()p/u(?5(?h:2 


p5g5r=l 

p^q^r 


p,q=l 

p¥=q 


^2  ffiCTnP6PiJ,q5qhiJ,p5piJ,q6qh1 


8/i6 


p,(?=i 

p+q 


+ 


(74(72 

w 


E2  ~  ~  ~  (j  2  2  —  (ji  ~  ~  ^ 

5qhC  iTp5pf-iq5qiiiJjq5qfqp5ph  +  ^ g  /  y  <5phC  /ig<5g/ir(5rh^iq(5(jr/ir(5)-h 


p//=i 

p+q 


p,q,r=l 

p^q¥=r 
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+ 


<7402 

1 W 


^  6pil^lpdpfJ,q5qh 


p,q= i 

pf=q 


+ 


+ 


<74<72 

8  h6 


E~  rj-t  2  ~  ~  r  0"  4(J2  ^ — ■>  ~  rjn  2  ~  ~  2 

/J>p5pHq5qhC  5pilfJ-q5qlJjpSph  +  g^g  /  y  fApfipl-lqdqhC  5q\lHp5p[iq5qh 


p,q=l 

pf=q 


p,q=l 

p+q 


<7o 


8/i6 


E~  rj~i  2  ~  — ' J  (X  2  ' '  <ji  2  ^  ^ 

/ip5p/ig5q<h(7  (5r  h/ip5p/ig(5g(h  +  g^g  /  v  5rll/ig(5g/ip5pll 


p5g,r=l 

p/g/r 


p,g,r=l 

Vi-q+r 


*2 


E  ~  rji  ~  c\  ~  ±  L/  4  U  2  X "V  ~  g~i  O  ~  ~  jf 

Hp5plJ,q5qilC  fJyp5pfJjq5qh5rh  +  g^g  /  y  H’pOpHqOqhC  5q\l/J>q5qfJjp5pil 
p,q,r= 1  p,g=l 

P7^<? 


+ 


+ 


<74<72 


8/i6 


^2 

8/i6 


E 

p,<j=i 

pf=q 

n 

E 


p5g,r=l 

p¥zq¥zr 


—  rj~r  ~  2  ~  _t  ~  rj-i  —  2  ~  jf 

g<h(7  /ip5p/igf5gh(5ph  +  //p^p/ig^grhC^  f^pSpfiq 5  gh5  g  h 


T  ~  ~T 


~  rp  ~  ~T  ~  rp  ~  ~P 

- 1-  flpSp  fl/gS  gYlCy  fJjgSgfJj'T  Sy  fJjpSp\\  fijpS p  fij  gS  (j^VC  fJjpS p /Mj- S  f\\  fJjf  S  j-  fJjgS  g\\ 


+ 


^2 

8/i6 


n 


p5g,r=l 

p/g/r 


n  \  n 

+  4/j2  {^phiejRj,j  +  Sph-jeiRi,i)  I  +  ^2 

p=l  /  '  p=l 


B.3  Proof  of  Lemma  5.1 


Proof. 


r0, 2(414-1)^7  } 


=  E  [(y(4)  -  y(4|4_i))(y(4)  -  y(/fc|4_i))T| Y^-i 
=  E  [  +  —-Daz^1  +  v  —  ^ 


(pAzh+^Lh  +  ^-C)  |yfc_j 


=  E 


( . 


1 


(  E>Azh  + +  uj  (  L>Azh  +  -L>A^h  +  f  J  |Lfc-i 


—  E  fpAzh  +  -i^Azh  “I-  ^  C1"^  —  C®  ^E^Azh  +  2^Az^*  “I*  v 


V 

+CCT 
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n,i(tk\tk-i)  =  E  [(x(4)  -  x(4|4-i))(y(4)  -  y{tk\tk-i))T\Yk-i] 

=  E  [A x(tk){y(tk)  -  y(4|4-i))T|Efc-i] 

=  E  SxAz(t.k )  ^ D/±zh  +  —D\z\i  +  v  —  c'j 

n,2(4|4-i)  =  E  SxAz(tk)(y(tk)  -y(4|4-i))T  (V(4)  -Y(4|4-i)) 

+E  £(4|4-i)(y(4)  -  y(4|4-i))T  (y(4)  -  Y(4|4-i)) 

=  E  [SxAz(tk)  {(yi{tk)  -  yi(tk\tk-i))(y(tk)  -  y(4|4-i))T,  •••, 
(yn(4)  -  yn(4|4-i))(y(4)  -  y(4|4-i))T}] 

+  x(4|4_i)E  [(7/1(4)  -  yi(4|4-i))(y(4)  -  y(4l4-i))T, 
(z/n(4)  -  3/ra(4|4-i))(y(4)  -  y(tk\tk-i))T] 

^0,3 (4 1 4- 1)  =  (E  (A2/i(4)Ayi(4)A7/(4)T))1^n>1^.^n 


+ 

+  l-D\z h  +  v  -  Cj  ^DAzh  +  l&Lh  +  v-C^j  |Ffe_ i 

=  E  [A4TA4T|ytfc_1]  -  E  [A4T^C,T|ytfc_1]  -  E  [AATCAT\Ytk_1\ 
+  E  [AAtCCt]  -  E  [ACtAAt]  +  E  [„4CT„4CT] 

+  E  [ACtCAt]  -  E  [ACtCCt] 


-D\Ja  +  v  —  C 


i>Azh  +  +  v  —  C 


ro,4  (4 1 4- 1)  =  E 


Mo,2(4|4-i)  =  (E  (Ay(4)Aj/j(4)Ayj(4)Ay(4)T))1<i<n 
?’2,2(4|4-i)  =  E  [Ax(4)Ax(4)TAy(4)Ay(4)'7] 

n  , 

=  E  SXJ2  [AziAzkSjik]  (  4Azh  +  -D2Azh  +  v-C 

k= 1 

|Yfc- 1 

=  SxQij,  where  Qjj  is  defined  below 

n,3(4|4-i)  =  E  [Ax(4)Ay(4)TAy(4)Ar/(4)T] 

i  n 

Qi,j  =  ^4  o-e^^fh^h2  +  ^2  ^2(T4Sj,i6phSphT 

p= i 
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+ y  ^  &2&ASjj, 


+ 


p= i 

(7-2(74 

IF 


SfhS;h  +6;h6fh 


+  E  vlSjffiffi 


p,q= i 
p^q 


E2  ~  ~  J  2  ~  ~  I  2  —  ~ 

h/^i^/^p^ph  “I-  Oph^^iMp^ph  H-  ^ph/ipjp/i^^h 

p=i 

2  ~  ~T’ 

+0i  h/i^^/ip^ph 

q  n 

(yK)  ^  "  _  ~T  ~  _  rj-(  ^  ^2 

H-  ^^4  ^  v  ^?,p  ^rh^.^i/^p^ph  +  ^h/ip^p/i^^h  H-  /^z^/^p^ph(5rh 

p,r=l 

p/r 

^  __  rj 

H-  l^p  &p  l^i^i  h(5r  h 


+ 


E  ~  2 ~ T  ~  2~T  ~~  r>2 ~ 'l 

Sj.p  [AiOilJjpOpYlOi  h  +  / / 7  O /  / /  p  ^'p h  ()p ll  -(-  // J; Op /  /  /  4 ?h  4p  h 


0204 

IF 

P=1 

~  ~2~1 

-\-  f  i  p  d  p  f  t  i  &i  h  (5  ;  h 


+ 


^2 

4/i4 


^  ^  ‘Sj'jP  yi8if-lq8qh^lq5qfj,p5ph  +  fJjpdpfJ,q5q\lfJ,p5pfJ,idih 


p,q= 1 

v+q 

~  r  ~T  ~  ~T' 

~\~  Iq-i8ifjyq5qilf.lp5pfj-q5qh  +  fJyp5pfJjqSqhfJ-i5ifJ-q5qh 


+ 


^2 

4/;4 


^  ^  <Sj',Q  fJ-p8plJ-i8iill7p5pl-lq5qh  +  /ip(5p/ig5gh/ip(5p//j5jh 


p,q=l 

p+q 

~  ~T  ~ 

+/ip<5p^tj(5jh/iq(5q/ip(5ph  +  f.ip5pfj-q5qhf4i5ii-ip5ph 


^2 


T  a| 
/l2 


4“  | ^  "  5  j .  i  [  (  p  8p  f  l  q  8  q  h  f  l  p  ()  p  /  /  q  8  q  h  + 

p,q=  i 
p+q 

~T  ~  ~T 

~h  ^j.pMi^hyxpOph  Sj.p  ftp  8j )  h  /  /  %  4V  h 


^  ^  <Sj!i^tp5ph/ip(5ph 

p=i 


+ 


+ 


ct2 


2h2 


O'. 


p=l 
2  n 


5phCT  +  C8l  hT 


H-  2 /^2  ^  v  *^jsp  [w^/^p^p^  “I-  /Xp^p/x^^hj  C* 


p=i 


2h2 


y  "  Sj.p  C^pSph  -\-  ('ftp dp ji-j  d /  h 


p=i 


where  Ax(4)  =  x(4)  -  x(4|4-i)>  A y(tk)  =  y{tk)  -  y(4|4-i)  and  M0,2(4|4-i)  can  be 
generated  from  ro,4  (t.k  \  tk- 1 )  □ 
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B.4  Proof  of  Lemma  5.2 


Proof.  From  (5.10)  and  applying  Baye’s  rule,  we  have 

P(x(4),y(4)|^fc-i)  =  P(®(4)|^tJJP(2/(4)|^fc_i)-  (B.l) 

Multiplying  equation  (B.l)  by  the  product  of  two  arbitrary  functions  s(x(tk ))  and  u(y(tk)),  and 
taking  the  expectations,  we  have 

J  j  s(x)u(y)P(x,y\Ytk_1)dxdy  =  J  J  s(x)u(y)P(x\Ytk)P(y\Ytk_1)dxdy 

=  j  J  s(x)P{x\Ytk)dx  u(y)P(y\Ytk_1)dy 
=  E[E  [s(*(4))l^fc]«(j/(4))^fc_1]. 

Hence, 

E  [S(x(4))n(y(4))l^fc-1]  =  E  [E  [s(x(tk))\Ytk]  u(y(4))|lVi]  .  (B.2) 

Equation  (B.2)  provides  a  systematic  feasible  procedure  for  solving  for  Ai ,  Bi,  i  =  0, 1,  and  A-2- 
Substituting  s  =  x(tk)  and  u  =  1,  we  have 

E  [x(tk)\Ytk-i]  =  E  [E  [x(tk)\Ytk] \Ytk_,]  .  (B.3) 

Hence 

E[*(4)|kVi]  =  E  [E  [x(tk)\Ytk]  |ktA._1]  . 

This  implies  that 

x(tk\tk-i)  =  E  [x(tk\tk)\Ytkl] 

=  E  A0  +  Ai(y(tk)  -  y(tk\tk-i))  +  A2(Y -Y)(y(t.k)  -  y(tk\tk-i))\Ytk_1  . 

Thus, 

n,o(4|4-i)  =  At(4|4-i)  +  ^2(4|4-i)oy2(4|4-i),  (B.4) 
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where  r-i)0(4|4-i)  =  £(4|4-i).  Substituting  s  =  x(tk)  and  u  =  (■ y(tk )  -  y(4|4-i))T>  we  have 


E  [x(tk)(y(tk)  -  y(4|4-i))T|Kfc_1] 

=  E  [E  [x(4)|KJ  (2/(4)  -  y(4|4-i))T|*Vi] 


=  E  [E  [(j40  +  M (y{tk)  -  y(4l4-i)) 


+^l2(Y  -  Y )(y(tk)  -  y(4|4-i))) 


( y(4 )  -  y(4|4-i))T 


IK 


^k- 


Hence, 


n,i(4|4-t)  =  ^i(4|4-t)ro,2(4|4-i)  +  A2(4|4-i)^3(4|4-i)- 
Lastly,  substituting  s  =  x(tk )  and  u  =  (y(tk)  —  y(4|4-i))T  (Y  —  Y)T,  we  have 


(B.5) 


E 


x(tk)(y{tk)  -  y(4|4-i))T(Y  -  Y)'r|Kfe_1 


=  E  [E  [x(4)|KJ  (2/(4)  -  2/(4|4-t))T(Y  -  Y)t|K,_1 

Hence, 

n,2(4|4-i)  =  A)(4|4-i)0y2(4|4-i)  +^4i(4|4-i)^o,3(4|4-i) 
+H2  (4 1 4-  i  )  Ma,2  (4 1 4-  i  )  • 

The  result  follows  by  solving  the  systems  of  linear  equations  {BA),  (4.5),  (4.7). 


(B.6) 


(B.7) 


□ 


B.5  Proof  of  Lemma  5.3 


Proof. 

First,  we  substitute  s  =  (. x(tk )  —  ®(4|4))(aj(4)  —  ®(4|4))T  and  u  =  1  into  equation  (4.2) 
and  obtain 

E  [(®(4)  -  £(4|4))(z(4)  -  ®(4|4))T|Kfc_1] 

=  E  [E  [(x(4)  -  x(4|4))(.x(4)  -  x(4|4))T|Kfc] 

=  E  [4(414)]  • 

Hence, 

-Ki  =  4q  +  4iro,2(4|4-i)-  (B.8) 
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Lastly,  substituting 


s  =  (x(tk)  -  x(tk\tk))(x(tk)  -  x{tk\tk))T 

u  =  (y(4)  -  y(4l4-i))(y(*fe)  -  y(tk\tk~i))T 


into  equation  (B.  2) 


N2  =  B0r0,2(tk\tk-i)  +  Bir0A. 


The  fifth  and  upper  moments  of  y(tk )  —  y(4|4-t)  is  neglected  in  No. 


(B.9) 


E  [0(4)  -x(4|4-t))(y(4)  -  y{tk\tk-i))T Aj (y(tk)  -y(4|4_i))x 
(y(4)  -  y(4l4-t))Tl*fc-i] 


can  be  generated  from  7*1,3, 

IE  [(x(4|4-i)  -  A0)(y(tk)  -y(tk\tk_i))TAj(y(tk)  -y(4|4-i))x 
0(4)  -#(4l4-i))T|it*_1] 


can  be  generated  from  7*0,3, 

E  [Ai(y(4)  -  y(4|4-i))0(4)  -  x(4|4-i))T(y(4)  -  y(4|4-i))x 
0(4)  -  y(4|4-t))rl>tfc_i] 

can  be  generated  from  7*1,3, 

E  [Ai(y(4)  -  y(4|4-i))0(4|4-i)  -  A0)T(y(tk )  -  y(4|4-t))x 
0(4)  -y(4|4-i))T|*tfc_1] 

can  be  generated  from  7*0,3, 

E  [Ai(y(tk)  -  y(4|4-i))(y(4)  -  y(4|4-i))r^TO(4)  -  y(4|4-i))x 
0(4)  -  y(4|4-i))Tl*tfc_i] 

can  be  generated  from  7*0,4,  where  7*1,3,  f 0,3,  and  7*0,4  arc  defined  in  Appendix  4.3.  The  conclusion 
of  the  Lemma  follows  by  solving  the  systems  of  equation  (B. 8)  and  ( 4.9).  □ 
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Appendix  C 


C.l  Proof  of  Lemma  6. 1 

Proof  of  Lemma  6.1  for  small  mk,  mk~ 1  <  m&,  Proof. 


i=l—mk 


Smk,k  —  /  F  %k— 1  — 

mk  .  “  mk 

i=l —mk 

^  l—mk_i 

=  TRk—  1  “1“  ^  ^  Xk—1 

mk 

i=l—mk 

+F°xk- 1] 


-  F 


s2 

0mk,k 


i 

mk 

1 


2n 


e  e 

i=— mfc+1  \j=-mfc+l 

-1 

E  (^-i)2+  E  (^*fc-i)2  +  (^°*fc-i): 

TTlfc  +  l 


1 


l 

mk 


o 


i=-mk_  i 

2n 


E  Fj'Xk 


-1 


1 

mk 

1 


rafc-i 

1 

H - 

mfc  L 


mfc 


Kj=-mk+l 

E 

i=-mk- i 
-1 

E  F^-i 


mfc-i 


E  F^-i  + 


U=-mfc_i 


i  i=-mfc_i 


(FV-i)2  -  (F-^-^fc-i)2  - 


—  mfe  — !  +  l 


E  +  E  ipixk-i y 


Ki=-mk+l 


i=—mk+ 1 
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_  _L  /V~-L  Qz  _  _L 

_  °mk_-\  ,k—l  '  _  Ljmk_-\  .k —  1  ^mu.k  ' 

mk  15  x’  fc’ 


-mfc-i+1 

2  E 


(i^fc-i) z-  (F-^-iXk^y  -  (F-m’'-i+1xk-1y  <=-X+i 


mk 


+ 


mk 


Hence, 


5m,fc 


mk-i  2 


»nfc 


„2  i  mk-i  o 2  _  o2 

t>mk—i,k— 1  '  w.k  Jmk-i,k—  1  °mk,k 


-mk_1  +  i 

2  E  (^**-1) 


(C.l) 


(CWi)  -(F-^-ixfc-O  -(F~mfc-i+1^-i)  fa-mfc+i 
'  mk  '  m*. 


Next,  we  find  an  expression  connecting  S2  k,  S2lk_  1  k_1  and  •s21fe_1  fc_1.  By  definition  and  sim¬ 
plification. 


mlSmk,k 


1  2 


E  ^**-1 

— m/e  +  1 


=  E  (F^fc_i)2+  E  FJsfc_1if’*a:fc_i 


i=— m^+l 


l,s=— mk-\-l 
l^s 


(rnk-l)smk-1,k-l  +  +  (F°Xfc-l)2  -  (F  "“-^k-l)2 

— mfc— l+l  0 

_(Jp-mfc-1+lXfc_1)2  +  ^  (FiXk_1)2+  E  F'xfc-iF-Sfc.! 

m^+l  l,s=-mk-\- 1 

l^s 


(C.2) 


Substituting  (C.2)  into  (C.l),  we  have 


5m,/c 


_  mfc  — 1 

_  mfc 


mk-i s2 


mk- 1 


mk  mk_i,k—l  '  rrifc  rafc_i,/c— 1 
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-mfc-i+l  2 

(F°a;fc_1)2-(F-mfe-i3;fc_1)2-(F-mfe-i+1a:fc_1)2 
'  Ynk  '  mk 


E  Flxk-iFsxk-i 
lis=-mk-\- 1 
l^s 


mk(mk- 1) 

Likewise,  using  equation  (C.2), 


(C.3) 


■m2  S2 

Also, 

2  52 

Hlfc— 2*-,rafi:_2,A;— 2 


K-2)4_J,t- 2  +  mk-2Sllk_2tk_2  +  (F  1Xk^1)2  -  (F  mfe-2  ^fc.i)2 

-mk-2  -1 

-(F-m*-2xfc_i)2  +  (Fixk-i)2  +  £  F'xfc-iF-Xfc.!. 

i=-mk_  i  l,s=—mk_i 

l^s 

{mk-3)s2mk_ S)fc-3  +  mfc_35^fc_3ifc_3  +  (F^2xk-i)2  -  {F~mk-3~2xk- 1)2 

— mfc-3  — 1  -2 

_(jF-mfc_3-lXfc_l)2  +  £  (F*Sfc_1)2+  ^ 

i=-mfc_2-l  l,s=-mk_  2-1 

l^/=s 
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Continuing  in  this  sense  and  substituting  k_t,  i  =  2,  ...,p  —  1  into  S^nk_i  k_v  we  have 


(mk-i)  S^llk_lk_1 


E 


1=2 


'ffl'k  —  i 


i  —  l 


n  mk~j 

3=1 


mk- 


,k—i 


i  + 


^ k—p  q2 

p—  l  ^rrik_p,k—p 

n  mk~j 

3  =  1 


p 

+  E 


i= 2 


(F~i+1x/c-1)2 

i—l 

n  mk~j 

3=1 


+  E 


1=2 


(F~i+  ^ 

i—l  2-/  i—l 

n  mk~j  i=2  n  mk~j 

3=1  3  =  1 


—  i+2  —  mu_A 

E  +^-i)2 

!w-i+2-mfe_f+1 

p 

+  E 

-i+i 

E  Flxk-iFsxk-i 

l,s=-i+2-mk-i+1 
l^S 

i  —  l 

i  —  l 

n  mfe-i 

i=2 

n  mfe-i 

1=1 

1=1 

(C-4) 


Finally,  the  result  follows  by  substituting  ((7.4)  into  ((7.3). 


□ 


C.2  Proof  Lemma  6.1 


Proof  of  Lemma  6.1  for  small  mk,  mk  <  i ,  Proof.  Following  the  same  steps,  if  mk  <  mk- 1, 


" 

s2 

m^  —  1 

P 

v 

l^k-i 

„2  1  «!fc-P  o2 

rrik,k 

mk 

2^ 

i  —  l 

d rrik—i,k—i  '  p— l  umk—p,k—p 

i=l 

n  mfe-i 

n  mfe-i 

.1=0 

1=0 

^mk-i,k—  1  — 


mfc  — 1 


P 

+  E 

i=i 


—  i+1  —  m 


£  (F-i+l**.!)2  £ 

2^  i—i  2^ 

i=t  n  mfe-j  *=i 

3=0 

:  ~i+1 

E  Flxk-iFsxk-i 

l,s=-i+2-mk-i+i 
l^S 

i  —  l 

n  m/.—j 

1=0 


fc  — i+1 

E  (i^fc-!)2 

i=  — i+1  — 


i  —  l 

n  mfe-i 

1=0 


-  i  ^  F'xfc-iF^Xfc-i, 


l,s=— mfc+1 
l^s 


□ 


C.3  Proof  Lemma  6.1 


Proof  of  Lemma  6.1  for  large  m/,:  Proof. 
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= 

°mk,k 


1 


mk-  1 
1 

mk  -  1 

1 


2n 


E  (^-i) 

i=-mk  + 1 


2  1 
mk 


Y  pjx fc 

U'=-mfc+l 


-1 


E  (Fxt-i)2  — —  (  E 


+  - 


mk- 1 


i=-mk_  i 

-1 


i  i=-mk-i 


+ 


1 


mk  —  1  L 


(F°xfc_i)2  -  (F-^-!xfe_i)2  -  (F-m*-1+1xfc_i): 


1 

mk 


o 


-mk~1+ 1 

E  F‘^-i  +  E 


i  i=-mfc+l 


i=— rrife  +  l 

_  .  I  • ' ' ^  c*2 

_  i  smt_i  1-1  '  ,  7  ‘->mk_]  ,k— 1 

mk  —  1  11  rnk  —  1  11 


mk—  1  1  2 

-s 


q2  mk  q2 

Dm ,  „  l.  i  —  - ~0, 


mk  -  1 


1 mk,k 


-mk_1  + 1 


+ 


(F^fc-!)2  -  (F-^-ixfc-i)2  -  (F-^-i+^-i)2  |  j=-Sfc+i  ^  Xfc  ^ 
mk  -  1 


mfc  -  1 


Hence, 


‘2  _  T»fc_i-1  o  I  mfc- 1  o2  _  mk  o2 

bm,k  mk  —  l  1  m*,—  1  °mk-\,k—  1  mk  —  l0mk,k 


+ 


(F°xfe_i)2-(F-mfe-i^_i)2-(F-mfc-i+1a;fe_i)2  ,  i=-Ufe+i^Xfe  ^ 

1  I  .  1 


(C.5) 


m/g  —  1 


m/g  —  1 


Next,  we  find  an  expression  connecting  fc,  _ ,  fc  l  and  s2n  _x  k_1.  By  definition. 


rff>  2  c2 

rnk°mk,k 


E 

i=— m^H-l 


1  2  o  q 

=  E  (Fixfc_i)2+  E  Flxk-1Faxk-1 

i=—mk+ 1  l,s=— mfc+1 

It/^S 

(mk- 1  -  l)«^fc_lifc_i  +  mk-iSmk-1,k-i  +  (F°xfe_ i)2  -  (F~mk~1xk-i)2 

-mk_  i+l  0 

_(jF—fc-i+lXfc_l)2  +  £  (i7iXfc_l)2+  £  F'ajfc-iF'Sfc-i 

m/c+l  l,s=— mk-\-l 

l^s 

(C 


Substituting  (C7.6)  into  (0.5),  we  have 


m,k 


mk- l-l  2 

m*.  amk—\,k—  1 


+ 


+ 


-mfc_l+1 

E 

i=  —  m^,  +  l 

rnk 


{Flxk- 1) 


mk-l  n2  _|_ 

mfe  °mk-i,k—l  ' 


(F°a;fc_1)2-(F-mfc-ia;fc_1)2-(F-mfc-i+1a;fc_1)2 

mk 


E  Flxk-1Faxk-i 
l,s=-mk-\- 1 
l^s 

mk(mk- 1) 

(C.7) 
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Likewise, 


mk- lSmk-Uk- 1  —  (mk- 2  -  l)smfe_2,fc-2  +  r71fc-2'S'mfc_2,fc-2  +  (-^  ^fc-l)2 

-mfc-2 

_(i?-mfe_2-lXfc_i)2  _  (F-m fc-2Xjk_l)2  +  £  (FVfc_!)2 

i=-mk_  i 

-1 

+  ^  Fz.Tfc-iFsxfc-i, 

lis=—mk— 1 
l^s 


ml-2Smk_2,k-2  =  imk- 3  -  l)Smfc_3,fc-3  +  mk-Ak_3,k-Z  +  (F  2Xfc_i)2 

—(F~mk-3~2Xk-i)2  -  (F~m>'-*-1xk-1)2  +  (^fc-i)2 

-2 

+  ^  Fzxfc_iFsxfc_i. 

l,s=—mk_2 

l^s 

Continuing  in  this  sense  and  substituting  Smk  i^-i,  i  =  2,  ...,p  —  1  into  fc_i,  we  have 


(mfc_i)5^fc_lifc_t  =  E 


i- 1 

1 1  rnk_j 
3  =  1 


3 mk_i,k—i 


I  'fFlk—p  q2 
—i  '  v—  1  ^TT 


n  mJ=-i 

i=i 


_  ^  (jEEiEz!^zO!  -y<  — 


mk_v,k—p  '  Z-/  i-i 

i=2  n  mk-] 
5= ! 

\2 

*a:fc_l ) 


i=2 


P 

+  E 

i=2 


P 

+  E 

i=2 


L[  mi,-  .j  i—2 

j= 1 

I]  Flxk _i 


2  —  1 

n 

i=i 


Z=— 2+2  — m 


fc  — 2+1 


2-1 

n  m/c-j 

i=i 
—  2  +  1 

I]  Flxk_iFsxk_i 

l,s=-i+2-mk_i+1 
l^S 

2—1 

n 

j=i 


Finally,  the  result  follows  by  substituting  (C.8)  into  (C.7). 


( C.8 ) 
□ 


C.4  Algorithm  and  Flowchart  For  Simulation 

The  simulated  estimate  y^  fe  for  the  energy  commodity  model  follows  the  Euler  scheme 

ymk,k  2/mfe_i,fc—  l_h®mfe_i,fc—  1  (Ymk_i,k—  1  ymk—i,k— l)ymk-i,k—  l^^'Fd^rnk_1,k— iymk_1,k— i  AWmfc)fc. 

(C-9) 
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Algorithm  2  Simulation  scheme 

Given  initials  r,  e,  {^0?0}moGo50?  -iWigOS-i  , 

{^mo,o}mo£05o’ 

for  k  =  1  to  iV  do, 

for  nik- 1  =  2tor  +  /c  —  2  do. 

Compute  omfe_1  i? 

for  mfc_2  =  2  to  r  +  k  —  3  do. 

Compute  5^1>fc_lf  s2mk  k,ysmk  k,  Zmk,k,yk 
end  for 
end  for 
end  for 

if  ^mk,k,yk  ^  e  then. 

Save  rhk,  mk- i,  rhk-2 

else 

Find  rhk  that  minimizes  ZmkAyk. 

end  if 

Compute  a^k, 


Similar  algorithm  can  be  generated  for  the  interest  rate  model. 

Remark  32  We  give  the  first  iterate  for  the  energy  commodity  model. 

Given  initials  r,  e,  {•smo  o}moeOSo’  {sm._i -i}m-ieOS_i>  {'S’m._1,-i}m_ieOS'_i5  { V m0 ,  o  }wj  e  O So > 
Compute  A*mo,o- 

For  k=l : 

Compute  j  using  (C.9).  If  Smijij2/1  <  e,  save  else,  find  values  of  mi  that 

minimizes  Smi;i)2/1. 

Compute  a„0)0,  o,4u, vV^v 

Next,  we  give  a  flowchart  similar  to  the  algorithm  above. 
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Flowchart  2:  LLGMM  Simulation  Algorithm. 
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Appendix  D 


D.  1  Proof  of  Lemma  9 . 3 

Proof  of  Lemma  9.3  for  small  rriy.,  nik- 1  <  //;/.,  Proof. 


1,1 

S  i  = 
mk,k 


L  E  <.Fzi(k-l))(F‘xj(k-l)) 


i=-mk  + 1 


e  *“*<(* -i>)(  E  F“zj(k- !) 

ya=-mfe  +  l  J  \a=— m.k+1 


-mk-i- 1 


;  (Ftxi(k-l)){Ftxj(k-l))+  J2  (Ftxi{k-l)){Ftxj(k-l)) 


L=-mk+ 1 


L=-mk- 1 


+  ++(£: -1))  (F°xj(fc-1))]  ^  Fax+-1)  ^  F%(fc-1) 


^  a=— mfc+1 


a=-mk-\- 1 


_  ITT'k- 1  i j  1  oi  of  _  o*  of 

*mfc_i,fc-l  'r  m  °mk-1,k—lJmk_1,k—l  °mk,kJmk)k 

-mk~  i+l 

£  FLXi{k-  l)FLXj(k-  1) 

=  —  771^  +  1 


F°®i(fc  -  l)F°a+fc  -  1)  -  F~mk~1Xi(k  -  l)F-mk-iXj(k  -  1) 

mk 

F-mk-i+ lx.(k  _  l)F~mk-i  +  lXj(k  -  1) 


Hence, 


1,3  _  wtfc_i  ij  ,  mfc_i  ™  o?  _  ™  o? 

bm,k  mk  bmk_i,k—l  '  mk  lDrak_i,k—l0mk_i,k—l  °mk)k°mk,k 

-mk_1+ 1 

E  FLXi{k—l)FLXj{k—l) 

L=~mk  +  i _ F°a;i(fc— l)F0Xj(fc— 1)  — F~mfc-1Xi(fc— 1) 

m*.  rrife 

(D.l) 
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Next,  we  find  an  expression  connecting  ^  and  S^S^.  By  defi¬ 

nition  and  simplification. 


m 


2  oi  oJ 
k^)mk^kkJmk^k 


E  F'xiik-  1)  E  F'xjik-l) 

i=— mfc+1  t=— rrifc+1 

0  0 

E  FLxi(k-l)Fixj{k-l)+  E  FlXi(k  —  l)FsXj(k  —  1) 

L=—mk+ 1  l,s=— mk+l 

l^s 

+  F°Xi(fc  -  l)F°Xj(A:  -  1) 

—F~mk~1Xi(k  -  l))F~mk-^Xj{k  -  1) 

_2T-mfc-1+la.i(fc  _  l)F-mk-i+lXj(k  -  1) 

— mfe— i  +  l 

+  E  FlXi(k  -  l)FlXj(k  -  1) 

t=— mfc+l 
0 

+  E  FlXi(k  -  l)FsXj(lb  -  1) 

l,S=  —  TTlfc  +  l 
l^S 

(D.2) 


Substituting  (.D.2)  into  (D.l),  we  have 


2,7 

m,k 


mk-l 

mk 

m,k  —  1 


Wlfc-l 

mk 


,  mfc— l  oi  oJ 

bmk_i,k—  1  mk  Jmk_i,k—lJmk_i,k—l 


+ 


™fc 


mk 

-mk_1+l 


F-mt.-1+l;r.(jt_1)F-mfc_1+l;I.^(fe_1)  ^  l=_mfc  +  1 


™fc 


2 

l,s=— mk+l 
l^s 


mk 


mk(mk- 1) 


Likewise,  using  (D.2), 


(D.3) 


HI  fc —  l^mk-i,k— 


1 


oi 

mk_i,k—  1 


(Hrfe-2)4Jfc_2,fe-2  +  mk-2Slmk_2yk_2S3mk_2k_2 

+F~1Xi(k  —  1  )F~1Xj(k  —  1) 

—F~mk~2~l Xi(k  -  l)F“mfc-2-1Xj(A:  -  1) 
—F~mk~2Xi(k  -  l)F~mk-2Xj(k  -  1) 

-mfc- 2 

+  ^  FLXi(k-  l)FlXj{k-  1) 

L=-mk_1 

-1 

l,s=— mk—i 
l^s 
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Also, 


ml-2Smk_2,k-Ak_2,k-2  =  (^-3)4Jfc_3,fc-3  +  mk-Ak_3,k-zSt 


mk_3,k-3 


Continuing  in  this  sense  and  substituting  S'mk_.  k-iumk  k-i 

41,Ml-1,w-we  have 


+F  2Xi(k  —  l)F  2Xj{k  —  1) 
—F~mk~3~2Xi(k  -  l )F-mk-3-2Xj(k  -  1) 
-F-mk-3~lXi{k  -  l )F~mk-3-1xj{k  -  1) 

-mk~  3-1 

+  FLXi(k-  l)FlXj(k-  1) 

i=-mk- 2-1 
-2 

+  FlXi(k-l)FsXj(k-l). 

l,s=—mk- 2  —  1 
l^s 

1  si.  i  =  2, ...,  d  —  1  into 


(mfc_i)54_i)fc_154_iA;_1  =  E 


mk  —  i 
l-1 

n  mk-j 

a= 1 


SlJ  I  mk-d  Qi  Qj 

d rrik—i,k—i  '  d— l  ^rrik—d^k— d^mk—d,^— d 


n 


+  £ 

1=2 


t-1 

n  mk  -:j 

a=  1 


-E 

t= 2 


L-1 

n  mfe-j 

a=l 

2-/  t-i 

'-=2  n 

a=l 

y.  FlXi(k—l)FlXj(k—l) 

l=-i+  2-mk_i  +  1 

1-1 

n  mk—j 

a=  1 

-*+!  , 

y  Flxi(k-l)Fsxj(k-l) 

l,s=-i+2-mk_i+1 
l^s 

— 1 

n  m-k-j 

a=  1 


d, 

+  £ 

i=2 


d 

+  £ 

t= 2 


(D.4) 


Finally,  the  result  follows  by  substituting  (DA)  into  (D. 3). 


□ 


D.2  Proof  of  Lemma  9.3  for  small  nik 

Proof  of  Lemma  9.3  for  small  m&,  m/;.  <  i ,  Proof.  Following  the  same  steps,  if  mp-  <  rrik-i, 
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l,J 

Q  1J 

mk,k 


mk  —  l 
mk 


d 

E 

Fft'k  —  i 

l-  1 

t=i 

n  m/.—j 

_  a=0 

ij  _l_  mfc-d  ai  aj 

d mk—i,k—i  '  d—  l  kJmk—d,k—dkJmk_(i,k 

n  mk~j 

a= 0 


+Wmk_uk-V  m'k  <  "lfc-1 

r 


l,J 

^mk_i,k—l 


mk  —  1 
mk 


d 

+  E 

t=i 


'-r  1  n  mk~j  1=1 

a= 0 

-»+! 

E  Fl  Xi(k—l)FaXj(k—l) 

l,s=~i+2-mk_i+1 
l^s 

T^l 

n  mfe-j 

a=0 


p-i+l-mfc_i+1 

E  FlXi{k 

l=  —  i+l  —  mk_i 

L^l 

n  mk~ 

a=0 


E  -  l)FaXj(k  -  1), 

l,s=— mk-\-l 

l^s 


D.3  Proof  of  Lemma  9.3  for  large  rnk 

Proof  of  Lemma  9.3  for  large  mk 
Proof. 


i,j 

S  7 
mk,k 


i 

-  1 


1 

mk  -  1 

1 

mk- 1 


E  {FlXi(k  —  1))  (FLXj{k  —  1)) 

m^+l 

0  \  /  0 

E  FaXi{k-  1)  E 
a=-mfe+l  J  \a=—mk+l 

-1 

E  FlXi(k  -  l)FlXj(k  -  1) 

t=-mk_  1 

-1  -1 

i=—mk_i  L=—mk_i 


+~r~  E  F‘xf(fc  - ')  E  f‘x#-d 

/  /  t/L —  1 

i=—mk—\  t=— mk_i 

+ — - —  -  l)F°x?(fc  -  1)  -  F~mk~1xi(k 

mk  —  1 

_jp-mfc-1+lx.(A.  _  1)F-mfc_1+la.^jfe  _ 


-d 


1  )FlXj{k- 


i(k~  1) 
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-mk~  i+l  -mk- i+l 

+^rl  £  F‘Xi(k- 1)  £ 

L=—mic-\-l  l=— m.fc+1 

u  0 

—  F+&-1)  F+fc-1) 


mk 


L=—mk+ 1 


*,=— mfc+1 


1  _ 1  i,j  |  mk-l  qj  qj  _ mk  qi  qj 

~^~Sm.k_1,k-l  '  m  _  ^  —  m  _  ^  mk,kamk,k 


mk  - 


F°Xi{k  -  l)F°Xj(fc  -  1)  -  F~rnk~1Xi(k  -  l)F-m*-ia+/c  -  1) 


+ 


mk  —  1 


-  ijir-mfc-i+ia.  (fc  _  !)  ^2^ +1 


-mfc_i+l 

E  F^(A:  -  l)FlXj(A:  -  1) 


mk  -  1 


+ 


mk  -  1 


Hence, 


i,i  _  rafc-i-1  J  J 


+- 


_  -l-1  <+ J  I  mk-l  qi  qj  _  mk  qi  qj 

^m^k  mk  —  1  ^mk—i,k— 1  '  mk  —  l°mk_\,k—l0mk—\,k—l  mk  —  l  ^m^^k^m^^k 

F0xi(k-l)F°xj(k-l)-F-rrlk-lxi(k-l)F-'mk-ixj(k-l)-F-rnk-i+1Xi(k-l)F-'mk-i+1xj(k-l) 

mk— 1 

£  Flxi(fc-l)FtXj(A:-l) 

|  t=-mfe+l 


mk  —  l 


(D.5) 


Next,  we  find  an  expression  connecting  ikS3mktk,  S'mk-1,k-1S3mk_ltk_1  and  By 

definition  and  simplification. 


mlSink,kSmk,k 


0  0 
X]  FLXi(k~  1)  X]  FLXj{k-  1) 
i=—mk+ 1  t=— mfc+1 

0 

L=-mk-\-l 

+  E  FlXi(k  -  l)FsXj(k  -  1) 
l,s=— mfc+1 
l^s 

(mk-l  - 

+F°x;(fe  -  1+++  -  1)  -  F~mk~1Xi(k  -  1  )F-mk^Xj(k  -  1) 

_F-mfc_i+la;.(A.  _  -  1) 

— mfe— i+l 

+  E  FbXi(k  —  1  )FLXj(k  —  1) 

mfc+1 

0 

+  E  F+(£;  -  1  )F8Xj(k  -  1) 

l,s=— mfc+1 
l^s 


(D.6) 


Substituting  (F.6)  into  (D.5),  we  have 
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mk_1-l  i,j  mk_ i  Qi  qj 

mk  ,/c— 1  '  mk  kJmk_i,k—lkJmk^i,k—l 

F0Xj(k—l)F0Xj(k—l)—F~rnk-1Xi(k—l)F-rnk-1Xj(k—l)—F-rnk-1+1Xi(k—l)F~rnk-1+1Xj(k—l) 

mk 


+ 


-mk_1  + 1 

Y  FLXi(k-l)FLXj(k-l) 

i=  —  mjc-\- 1 

rn~k 


o 

Y  Fl  Xi{k—1)FS  Xj{k—1) 
l,s=  —  ra/e  +  1 
l^s 

mk(mk- 1) 


(D.7) 


Likewise, 


mk- 1  x  ,k- 1 


+F  1Xi(k—  1)F  1Xj(k  —  1) 


—F~rnk-^~lXi{k  -  l)F~mk~2^1xj(k  -  1) 


—F~mk~2Xi(k  -  l)F~mk-2Xj(k  -  1) 

-mk~  2 

+  ^  F^A;  -  l)F%-(ife  -  1) 

L=-mk- 1 


-1 

+  F^A;  -  l)FaXj(A:  -  1), 

Z,S— —  7Ylk_\ 
l^S 


mk-2bmk_2,k-2bmk_ 


{mk- 3  -  l)s 


mk_3,k-3 


+  mk-3Szmk_3^k_  3 


mk-3,k-3 


+F  2Xi(k—l)F  2Xj(k  —  1) 


—F~mk-3~2Xi(k  -  l )F~mk-3-2Xj(k  -  1) 
—F~mk~3~1Xi(k  -  l)F"mfc-3~1xi(A;  -  1) 

+  ^  FkXi(k  -  l)Fl'Xj(k  -  1) 

t=-)7lfc_2-l 


-2 

+  FlXi(k  -  l)FsXj{k  -  1). 

l,s=-mk- 2 
l^s 


Continuing  in  this  sense  and  substituting  Smk_uk-i,  i  =  2, d  —  1  into  we  have 


E 

t=2 


i-i 

n  mk~j 

-  a=  1 


JJ  I  mk_d 

d mk_i,k—i  '  d— l 

n  mfe-j 

a=l 


'  t-1 

i=2  fl  mfc_j 


oi  oj 

‘Jmk_d,k-d^Jmk_d,k-d 


iXi(k—l)F~i+1~rnk-iXj(k—l) 

L-  1 


(D.8) 
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d  F_i+2_mfc_jxi(fe_1)F_i+2-mfc_ia.i(fc_1) 

2_v  t-i  "F  z_> 


t=2 


d 

+  £ 

t=2 


t-l 

n  mfc-j 

a=l 


d 

r) 

t=2 


-i+l 

E 


— »+2-mfc_j 

y,  FlXi(k—l)FlXj(k—l) 

l  =  -i+2-mk_i  +  1 

1^1 

n 

a=l 


i,s=-i+2-mfc_i+i 
l^s 


FlXi(k-l)FsXj(k-l) 


L~  1 

n  mk-j 

a= 1 


(D.9) 


Finally,  the  result  follows  by  substituting  ( A). 8)  into  (D.7). 


□ 
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